Sep 11 16:02:14.759920 ip-10-0-130-241 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 16:02:15.080546 ip-10-0-130-241 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:02:15.080546 ip-10-0-130-241 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 16:02:15.080546 ip-10-0-130-241 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:02:15.080546 ip-10-0-130-241 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 16:02:15.080546 ip-10-0-130-241 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:02:15.082625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.082538    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 16:02:15.086480 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086466    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:15.086480 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086480    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086483    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086486    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086490    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086493    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086495    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086499    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086502    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086504    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086507    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086509    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086512    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086514    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086517    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086519    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086522    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086524    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086528    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086531    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086533    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:15.086537 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086536    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086538    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086542    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086544    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086547    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086550    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086552    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086555    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086557    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086560    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086562    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086564    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086567    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086569    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086571    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086574    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086576    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086579    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086582    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086584    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:15.087647 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086587    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086589    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086591    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086594    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086596    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086599    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086601    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086603    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086606    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086609    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086611    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086626    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086629    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086631    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086637    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086639    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086642    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086645    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086648    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086650    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:15.088175 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086653    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086656    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086658    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086662    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086666    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086669    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086671    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086674    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086676    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086679    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086682    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086685    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086687    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086690    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086692    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086695    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086697    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086699    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086702    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086705    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:15.088692 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086707    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086710    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086713    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086718    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086722    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086725    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086729    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086732    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086735    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086738    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086741    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086744    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086747    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086749    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086752    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086755    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086757    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.086759    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087417    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:15.089158 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087423    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087427    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087429    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087432    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087436    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087438    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087442    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087444    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087447    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087449    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087452    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087455    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087457    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087459    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087462    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087464    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087467    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087469    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087472    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:15.089605 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087475    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087478    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087480    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087483    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087485    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087488    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087490    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087493    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087496    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087498    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087501    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087503    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087506    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087508    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087511    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087515    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087519    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087522    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087526    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:15.090108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087528    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087531    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087534    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087537    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087540    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087542    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087545    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087548    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087550    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087552    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087556    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087558    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087560    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087563    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087566    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087568    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087571    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087574    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087576    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087579    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:15.090589 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087581    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087584    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087586    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087589    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087593    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087596    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087599    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087602    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087606    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087608    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087611    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087629    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087632    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087635    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087637    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087640    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087642    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087645    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087648    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087650    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:15.091080 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087653    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087655    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087658    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087660    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087664    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087666    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087669    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087672    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087674    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087677    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087679    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087682    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087686    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087690    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087692    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087695    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087697    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087700    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087703    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.087705    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:15.091553 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088099    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088105    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088109    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088112    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088115    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088118    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088121    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088124    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088126    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088128    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088131    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088134    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088138    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088141    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088143    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088146    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088149    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088151    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088154    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:15.092042 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088158    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088161    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088164    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088167    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088170    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088173    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088175    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088178    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088181    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088185    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088188    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088190    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088193    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088195    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088198    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088200    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088202    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088204    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088207    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088210    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:15.092495 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088214    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088216    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088220    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088223    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088226    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088229    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088231    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088234    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088236    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088239    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088242    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088244    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088248    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088250    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088253    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088255    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088258    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088260    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088263    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:15.092976 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088265    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088268    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088270    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088272    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088275    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088277    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088279    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088282    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088284    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088286    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088289    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088291    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088294    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088296    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088299    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088301    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088303    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088306    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088308    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088311    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:15.093431 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088313    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088316    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088318    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088321    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088323    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088326    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088328    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088331    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088333    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088336    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088338    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088341    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088343    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088346    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088348    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088351    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088353    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088355    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088358    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088360    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.088363    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:15.093907 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088428    2557 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088464    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088472    2557 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088477    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088481    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088484    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088488    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088492    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088496    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088499    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088502    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088505    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088508    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088514    2557 flags.go:64] FLAG: --cgroup-root=""
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088517    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088520    2557 flags.go:64] FLAG: --client-ca-file=""
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088522    2557 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088525    2557 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088530    2557 flags.go:64] FLAG: --cluster-domain=""
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088532    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088536    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088539    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088542    2557 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088546    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 16:02:15.094394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088548    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088551    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088554    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088557    2557 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088560    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088563    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088566    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088569    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088573    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088575    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088578    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088581    2557 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088586    2557 flags.go:64] FLAG: --enable-server="true"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088589    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088594    2557 flags.go:64] FLAG: --event-burst="100"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088597    2557 flags.go:64] FLAG: --event-qps="50"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088600    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088603    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088606    2557 flags.go:64] FLAG: --eviction-hard=""
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088609    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088612    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088627    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088630    2557 flags.go:64] FLAG: --eviction-soft=""
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088633    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088636    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 16:02:15.094973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088639    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088642    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088644    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088647    2557 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088650    2557 flags.go:64] FLAG: --feature-gates=""
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088654    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088657    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088660    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088663    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088666    2557 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088669    2557 flags.go:64] FLAG: --help="false"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088672    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088675    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088677    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088680    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088684    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088687    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088690    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088693    2557 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088698    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088701    2557 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088705    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088708    2557 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088710    2557 flags.go:64] FLAG: --kube-reserved=""
Sep 11 16:02:15.095639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088713    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088716    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088719    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088722    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088727    2557 flags.go:64] FLAG: --lock-file=""
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088730    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088732    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088735    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088741    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088743    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088746    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088749    2557 flags.go:64] FLAG: --logging-format="text"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088752    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088755    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088757    2557 flags.go:64] FLAG: --manifest-url=""
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088760    2557 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088765    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088767    2557 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088776    2557 flags.go:64] FLAG: --max-pods="110"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088779    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088782    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088785    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088788    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088791    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088793    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 16:02:15.096218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088797    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088803    2557 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088807    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088810    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088813    2557 flags.go:64] FLAG: --pod-cidr=""
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088817    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088822    2557 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088825    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088828    2557 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088831    2557 flags.go:64] FLAG: --port="10250"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088834    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088838    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-089fa51347d51e5d7"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088841    2557 flags.go:64] FLAG: --qos-reserved=""
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088844    2557 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088847    2557 flags.go:64] FLAG: --register-node="true"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088850    2557 flags.go:64] FLAG: --register-with-taints=""
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088853    2557 flags.go:64] FLAG: --registry-burst="10"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088856    2557 flags.go:64] FLAG: --registry-qps="5"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088859    2557 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088862    2557 flags.go:64] FLAG: --reserved-memory=""
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088865    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088868    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088871    2557 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088874    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088877    2557 flags.go:64] FLAG: --runonce="false"
Sep 11 16:02:15.096825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088880    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088883    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088886    2557 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088889    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088891    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088894    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088897    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088900    2557 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088903    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088905    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088909    2557 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088912    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088915    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088919    2557 flags.go:64] FLAG: --system-cgroups=""
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088922    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088927    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088930    2557 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088933    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088938    2557 flags.go:64] FLAG: --tls-min-version=""
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088941    2557 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088943    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088946    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088949    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088952    2557 flags.go:64] FLAG: --v="2"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088955    2557 flags.go:64] FLAG: --version="false"
Sep 11 16:02:15.097413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088959    2557 flags.go:64] FLAG: --vmodule=""
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088963    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.088966    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089076    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089080    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089083    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089086    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089088    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089092    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089096    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089100    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089104    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089108    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089110    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089113    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089115    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089118    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089122    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089124    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089127    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:15.098024 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089130    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089133    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089136    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089139    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089141    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089145    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089148    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089150    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089152    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089155    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089158    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089160    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089163    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089166    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089168    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089171    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089174    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089176    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089179    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089181    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:15.098489 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089183    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089186    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089188    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089191    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089193    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089195    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089198    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089200    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089203    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089207    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089210    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089212    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089215    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089217    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089220    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089223    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089225    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089229    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089231    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089235    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:15.099038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089239    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089241    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089244    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089247    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089249    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089252    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089255    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089257    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089260    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089262    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089264    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089267    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089269    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089272    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089274    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089277    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089279    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089281    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089284    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089288    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:15.099546 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089291    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089296    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089299    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089302    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089305    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089308    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089311    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089314    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089317    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089320    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089323    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089326    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089328    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089331    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089333    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089336    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089338    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089341    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089343    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:15.100038 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089346    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089348    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.089351    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.089972    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.096914    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.096932    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.097599    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.097609    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097683    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097689    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097694    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097698    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097701    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097704    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:15.100482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097707    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097710    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097713    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097716    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097718    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097721    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097724    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097726    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097729    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097732    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097734    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097737    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097739    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097746    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097749    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097751    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097754    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097757    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097759    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097762    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:15.100854 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097764    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097767    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097769    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097778    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097782    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097784    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097787    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097789    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097792    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097794    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097797    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097800    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097802    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097806    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097809    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097812    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097814    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097817    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097819    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:15.101351 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097822    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097824    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097827    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097829    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097832    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097835    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097837    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097839    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097842    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097844    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097847    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097849    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097853    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097856    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097859    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097861    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097864    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097873    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097876    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097878    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:15.101849 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097881    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097883    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097886    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097888    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097891    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097893    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097896    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097898    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097900    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097903    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097905    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097908    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097910    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097913    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097915    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097918    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097920    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097922    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097925    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097928    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:15.102336 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097930    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097932    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097935    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097937    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097939    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097942    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097945    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097947    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097950    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097953    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097961    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097963    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097966    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.097968    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.097974    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:02:15.102889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098148    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098153    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098156    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098159    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098162    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098165    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098168    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098170    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098173    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098176    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098178    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098180    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098183    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098185    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098188    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098191    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098193    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098195    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098198    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098200    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:02:15.103277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098202    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098205    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098207    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098210    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098212    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098215    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098218    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098220    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098228    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098232    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098234    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098236    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098239    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098241    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098244    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098246    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098248    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098251    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098253    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:02:15.103806 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098256    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098258    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098260    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098264    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098267    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098270    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098273    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098276    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098279    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098281    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098284    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098286    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098289    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098291    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098294    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098296    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098299    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098302    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098305    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:02:15.104283 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098307    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098309    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098312    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098320    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098322    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098325    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098327    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098330    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098332    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098335    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098337    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098339    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098342    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098345    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098348    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098351    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098353    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098355    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098358    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098360    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:02:15.104771 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098363    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098365    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098368    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098370    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098373    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098375    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098378    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098380    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098384    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098387    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098390    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098393    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098395    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098398    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098400    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098402    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098410    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098413    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098421    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098423    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:02:15.105248 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:15.098426    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.098430    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.098565    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.100729    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.101510    2557 server.go:1019] "Starting client certificate rotation"
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.101630    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.101666    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:02:15.105796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.103689    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:02:15.108374 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.108334    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:02:15.118059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.118039    2557 log.go:25] "Validated CRI v1 runtime API"
Sep 11 16:02:15.122290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.122272    2557 log.go:25] "Validated CRI v1 image API"
Sep 11 16:02:15.123104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.123089    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 16:02:15.125635 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.125602    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7c7e01b6-9d82-4325-9141-f7d1e3a85848:/dev/nvme0n1p4 f90eb44f-a4e8-4bf5-bbef-d6d259d1dede:/dev/nvme0n1p3]
Sep 11 16:02:15.125696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.125635    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 16:02:15.130396 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.130291    2557 manager.go:216] Machine: {Timestamp:2026-09-11 16:02:15.12908836 +0000 UTC m=+0.269703367 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3184494 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29ebec4baad6fd6fedb75075ffa2f5 SystemUUID:ec29ebec-4baa-d6fd-6fed-b75075ffa2f5 BootID:17cf5b7a-a914-4924-8e85-007f2b50f0bd Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:43:4b:23:55:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:43:4b:23:55:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:69:0c:b7:bf:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 16:02:15.130396 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.130388    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 16:02:15.130539 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.130457    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 16:02:15.133116 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.133087    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 16:02:15.133286 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.133118    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 16:02:15.133817 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.133802    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:02:15.133872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.133827    2557 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 16:02:15.133872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.133849    2557 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 16:02:15.133872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.133862    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:02:15.134403 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.134391    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:02:15.135279 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.135269    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 16:02:15.139759 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139746    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:02:15.139902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139890    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 16:02:15.139957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139928    2557 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 16:02:15.139957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139947    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 16:02:15.140043 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139966    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 16:02:15.140043 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139979    2557 kubelet.go:398] "Adding apiserver pod source"
Sep 11 16:02:15.140043 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.139991    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 16:02:15.140335 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.140322    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:02:15.140392 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.140343    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:02:15.142090 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.142069    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 16:02:15.143951 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.143937    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 16:02:15.144006 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.143967    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 16:02:15.145578 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145565    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145583    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145589    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145594    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145603    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145608    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145639    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 16:02:15.145646 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145646    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 16:02:15.145828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145652    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 16:02:15.145828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145657    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 16:02:15.145828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145673    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 16:02:15.145828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.145678    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 16:02:15.146302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.146293    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 16:02:15.146302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.146301    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 16:02:15.149995 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.149981    2557 server.go:1268] "Started kubelet"
Sep 11 16:02:15.150086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.150047    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 16:02:15.152700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.150106    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 16:02:15.152781 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.152746    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 16:02:15.152987 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.152949    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 16:02:15.153143 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.153122    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 16:02:15.153211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.153130    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 16:02:15.153180 ip-10-0-130-241 systemd[1]: Started Kubernetes Kubelet.
Sep 11 16:02:15.155139 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.154950    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 16:02:15.157683 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.157669    2557 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 16:02:15.159064 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.159048    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 16:02:15.159200 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.158404    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-241.ec2.internal.18d44fa80c27adcd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-241.ec2.internal,UID:ip-10-0-130-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-241.ec2.internal,},FirstTimestamp:2026-09-11 16:02:15.149956557 +0000 UTC m=+0.290571565,LastTimestamp:2026-09-11 16:02:15.149956557 +0000 UTC m=+0.290571565,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-241.ec2.internal,}"
Sep 11 16:02:15.160813 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.160790    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 16:02:15.161340 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.161258    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 16:02:15.161654 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.161635    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.161926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.161912    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 16:02:15.162030 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162020    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 16:02:15.162162 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162088    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 16:02:15.162162 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162108    2557 factory.go:55] Registering systemd factory
Sep 11 16:02:15.162255 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162177    2557 factory.go:223] Registration of the systemd container factory successfully
Sep 11 16:02:15.162255 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162194    2557 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 16:02:15.162255 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162201    2557 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 16:02:15.162436 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162423    2557 factory.go:153] Registering CRI-O factory
Sep 11 16:02:15.162472 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162440    2557 factory.go:223] Registration of the crio container factory successfully
Sep 11 16:02:15.162503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162495    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 16:02:15.162531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162517    2557 factory.go:103] Registering Raw factory
Sep 11 16:02:15.162557 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162532    2557 manager.go:1196] Started watching for new ooms in manager
Sep 11 16:02:15.162996 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.162982    2557 manager.go:349] Starting recovery of all containers
Sep 11 16:02:15.167725 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.167690    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 16:02:15.167823 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.167790    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 16:02:15.173333 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.173315    2557 manager.go:354] Recovery completed
Sep 11 16:02:15.173910 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.173890    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cr7tm"
Sep 11 16:02:15.179175 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.179002    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.181746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.181723    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.181827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.181754    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.181827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.181764    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.181827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.181819    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cr7tm"
Sep 11 16:02:15.182317 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.182301    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 16:02:15.182317 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.182308    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.182428 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.182312    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 16:02:15.182428 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.182370    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:02:15.183114 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.183098    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.183166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.183127    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.183166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.183136    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.183633 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.183561    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-241.ec2.internal.18d44fa80e0cbaf4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-241.ec2.internal,UID:ip-10-0-130-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-241.ec2.internal,},FirstTimestamp:2026-09-11 16:02:15.181744884 +0000 UTC m=+0.322359891,LastTimestamp:2026-09-11 16:02:15.181744884 +0000 UTC m=+0.322359891,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-241.ec2.internal,}"
Sep 11 16:02:15.184943 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.184928    2557 policy_none.go:49] "None policy: Start"
Sep 11 16:02:15.185007 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.184948    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 16:02:15.185007 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.184960    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 16:02:15.187077 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.187061    2557 policy_none.go:47] "Start"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.222990    2557 manager.go:337] "Starting Device Plugin manager"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.223029    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.223040    2557 server.go:87] "Starting device plugin registration server"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.223350    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.223360    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.223486    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.223561    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.223569    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.224011    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 16:02:15.241579 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.224051    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.294490 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.294461    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 16:02:15.295595 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.295580    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 16:02:15.295705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.295642    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 16:02:15.295705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.295674    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 16:02:15.295813 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.295718    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 16:02:15.297976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.297956    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:15.323951 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.323933    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.324864 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.324847    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.324963 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.324882    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.324963 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.324897    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.324963 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.324925    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.333351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.333272    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.333351 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.333298    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-241.ec2.internal\": node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.345326 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.345309    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.396772 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.396737    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"]
Sep 11 16:02:15.396867 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.396809    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.397706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.397691    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.397781 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.397719    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.397781 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.397728    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.400149 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400136    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.400284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400269    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.400343 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400306    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.400898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400880    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.400981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400908    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.400981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400923    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.400981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.400977    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.401124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.401013    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.401124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.401029    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.403336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.403320    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.403413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.403350    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:02:15.404102 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.404085    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:02:15.404175 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.404113    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:02:15.404175 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.404132    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:02:15.422136 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.422119    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-241.ec2.internal\" not found" node="ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.426241 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.426222    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-241.ec2.internal\" not found" node="ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.446265 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.446240    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.464628 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.464589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d106852fe9cba1c1b928ec423e65e68-config\") pod \"kube-apiserver-proxy-ip-10-0-130-241.ec2.internal\" (UID: \"3d106852fe9cba1c1b928ec423e65e68\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.464713 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.464632    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be16f24f8a338b8813634cec41ddf846-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal\" (UID: \"be16f24f8a338b8813634cec41ddf846\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.464713 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.464665    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be16f24f8a338b8813634cec41ddf846-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal\" (UID: \"be16f24f8a338b8813634cec41ddf846\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.546860 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.546828    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.565768 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.565742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be16f24f8a338b8813634cec41ddf846-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal\" (UID: \"be16f24f8a338b8813634cec41ddf846\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.565885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.565777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be16f24f8a338b8813634cec41ddf846-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal\" (UID: \"be16f24f8a338b8813634cec41ddf846\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.565885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.565802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d106852fe9cba1c1b928ec423e65e68-config\") pod \"kube-apiserver-proxy-ip-10-0-130-241.ec2.internal\" (UID: \"3d106852fe9cba1c1b928ec423e65e68\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.565885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.565852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3d106852fe9cba1c1b928ec423e65e68-config\") pod \"kube-apiserver-proxy-ip-10-0-130-241.ec2.internal\" (UID: \"3d106852fe9cba1c1b928ec423e65e68\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.565885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.565860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be16f24f8a338b8813634cec41ddf846-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal\" (UID: \"be16f24f8a338b8813634cec41ddf846\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.566026 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.565860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be16f24f8a338b8813634cec41ddf846-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal\" (UID: \"be16f24f8a338b8813634cec41ddf846\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.647732 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.647659    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.724251 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.724216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.729779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:15.729394    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:15.748138 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.748115    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:15.848649 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:15.848593    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:17.539637 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:17.539576    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:17.640095 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:17.640063    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:17.691562 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.691538    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 16:02:17.691954 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.691681    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:02:17.728338 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.728316    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:17.740570 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:17.740549    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:17.776999 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.776955    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 15:57:16 +0000 UTC" deadline="2028-03-24 08:24:51.064615974 +0000 UTC"
Sep 11 16:02:17.777167 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.777015    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13432h22m33.287623736s"
Sep 11 16:02:17.841339 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:17.841275    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-241.ec2.internal\" not found"
Sep 11 16:02:17.890984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.890956    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:17.905076 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:17.905028    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe16f24f8a338b8813634cec41ddf846.slice/crio-325e4df30f6c11986681a3acbd9dbcabb82f6226f7b38fe886c57960faa724c3 WatchSource:0}: Error finding container 325e4df30f6c11986681a3acbd9dbcabb82f6226f7b38fe886c57960faa724c3: Status 404 returned error can't find the container with id 325e4df30f6c11986681a3acbd9dbcabb82f6226f7b38fe886c57960faa724c3
Sep 11 16:02:17.905321 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:17.905300    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d106852fe9cba1c1b928ec423e65e68.slice/crio-2e399bfc3d6b3638f3f1c9b20a263a4b48b33975e606ccb8425f843ba10994fe WatchSource:0}: Error finding container 2e399bfc3d6b3638f3f1c9b20a263a4b48b33975e606ccb8425f843ba10994fe: Status 404 returned error can't find the container with id 2e399bfc3d6b3638f3f1c9b20a263a4b48b33975e606ccb8425f843ba10994fe
Sep 11 16:02:17.909214 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.909201    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:02:17.952635 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.952614    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:17.961301 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.961281    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:02:17.962854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.962842    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal"
Sep 11 16:02:17.973629 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:17.973617    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:02:18.048350 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.048323    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:18.731984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.731946    2557 apiserver.go:52] "Watching apiserver"
Sep 11 16:02:18.739578 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.739553    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 16:02:18.739966 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.739937    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h","openshift-cluster-node-tuning-operator/tuned-rbn4v","openshift-dns/node-resolver-npr6z","openshift-image-registry/node-ca-d6zfb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal","openshift-multus/multus-additional-cni-plugins-jxx4m","kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal","openshift-multus/multus-4s8pm","openshift-multus/network-metrics-daemon-b2ggg","openshift-network-diagnostics/network-check-target-hmg8r","openshift-network-operator/iptables-alerter-jnw89","openshift-ovn-kubernetes/ovnkube-node-d9gbr","kube-system/global-pull-secret-syncer-xh55j","kube-system/konnectivity-agent-ws8nc"]
Sep 11 16:02:18.742571 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.742549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:18.742658 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.742635    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:18.744615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.744595    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.746813 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.746790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.746955 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.746936    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.747291 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.747257    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6hhxw\""
Sep 11 16:02:18.747382 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.747354    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.749016 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.748996    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.749555 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.749440    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.749638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.749584    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nn4b2\""
Sep 11 16:02:18.749850 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.749834    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.751276 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.751242    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.751495 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.751479    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-958xn\""
Sep 11 16:02:18.751818 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.751707    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 16:02:18.751860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.751840    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.752134 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.752114    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.752230 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.752216    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 16:02:18.753572 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.753553    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.753656 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.753608    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 16:02:18.753755 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.753738    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hk6qk\""
Sep 11 16:02:18.753889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.753872    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 16:02:18.754221 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.754201    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.754308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.754237    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.755610 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.755589    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.756078 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.756036    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.756165 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.756130    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.756222 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.756171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rz6hd\""
Sep 11 16:02:18.756272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.756038    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 16:02:18.758131 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.758081    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.758218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.758157    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mczd9\""
Sep 11 16:02:18.758615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.758478    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 16:02:18.759067 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.759020    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.759161 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.759115    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.759219 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.759167    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:18.763542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:18.763628 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.763610    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:18.763717 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhff\" (UniqueName: \"kubernetes.io/projected/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-kube-api-access-tfhff\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.763772 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-cni-bin\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.763772 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74f485b2-9315-4f61-acb8-35d9722ac245-multus-daemon-config\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.763849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763797    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-multus-certs\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.763849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763820    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/697065e3-6f8f-43d4-8edb-d9e197403f23-host-slash\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.763849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:18.763945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdad1164-7fe4-4356-904e-3fef58433988-tmp\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.763945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f485b2-9315-4f61-acb8-35d9722ac245-cni-binary-copy\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.763945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-etc-kubernetes\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764036 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763943    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-modprobe-d\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764036 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.763981    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-host\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764036 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jdb7\" (UniqueName: \"kubernetes.io/projected/bdad1164-7fe4-4356-904e-3fef58433988-kube-api-access-4jdb7\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764036 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70ef2110-78b6-4ecd-b9be-199eb5bee58b-host\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.764192 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70ef2110-78b6-4ecd-b9be-199eb5bee58b-serviceca\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.764192 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764095    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-hostroot\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764192 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q9bd\" (UniqueName: \"kubernetes.io/projected/74f485b2-9315-4f61-acb8-35d9722ac245-kube-api-access-7q9bd\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764192 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9gfl\" (UniqueName: \"kubernetes.io/projected/697065e3-6f8f-43d4-8edb-d9e197403f23-kube-api-access-g9gfl\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.764192 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-kubelet\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-k8s-cni-cncf-io\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-cni-multus\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764249    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysctl-conf\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-lib-modules\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/697065e3-6f8f-43d4-8edb-d9e197403f23-iptables-alerter-script\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.764372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysctl-d\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764377    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-systemd\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764397    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-cni-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-conf-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764458    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-kubernetes\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-run\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764511    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-sys\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764534    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-var-lib-kubelet\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bdad1164-7fe4-4356-904e-3fef58433988-etc-tuned\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764593    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-tmp-dir\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764623    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcrdt\" (UniqueName: \"kubernetes.io/projected/70ef2110-78b6-4ecd-b9be-199eb5bee58b-kube-api-access-zcrdt\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-system-cni-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.764706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764664    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-cnibin\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.765217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-socket-dir-parent\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.765217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764793    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-netns\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.765217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764813    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysconfig\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.765217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.764829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-hosts-file\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.765878 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.765857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.767625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.767603    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:02:18.767983 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.767965    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rdv9x\""
Sep 11 16:02:18.768355 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.768224    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 16:02:18.768355 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.768234    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 16:02:18.768576 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.768508    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.770738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.770706    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 16:02:18.770832 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.770761    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5b5zx\""
Sep 11 16:02:18.770832 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.770766    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.770990 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.770973    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 16:02:18.770990 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.770982    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 16:02:18.771741 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.771722    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 16:02:18.771822 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.771771    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 16:02:18.771822 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.771800    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 16:02:18.772843 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.772826    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xmj6x\""
Sep 11 16:02:18.773004 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.772977    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 16:02:18.773004 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.772994    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 16:02:18.791503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.791482    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5b54h"
Sep 11 16:02:18.799531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.799509    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5b54h"
Sep 11 16:02:18.854450 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.854423    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 16:02:18.865056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysctl-d\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865060    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-systemd\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-etc-selinux\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.865185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc-konnectivity-ca\") pod \"konnectivity-agent-ws8nc\" (UID: \"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc\") " pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.865185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865133    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-cni-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.865185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-run\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-sys\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865186    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysctl-d\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-var-lib-kubelet\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865221    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bdad1164-7fe4-4356-904e-3fef58433988-etc-tuned\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-run\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-systemd\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865258    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-ovn\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865269    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-sys\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865293    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-cni-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865294    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-var-lib-kubelet\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865296    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-env-overrides\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-device-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.865387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865364    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-tmp-dir\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcrdt\" (UniqueName: \"kubernetes.io/projected/70ef2110-78b6-4ecd-b9be-199eb5bee58b-kube-api-access-zcrdt\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-system-cni-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865482    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-socket-dir-parent\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865505    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-netns\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysconfig\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865579    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da590729-c278-4d83-81b0-2105f798493b-ovn-node-metrics-cert\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-hosts-file\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-tmp-dir\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74f485b2-9315-4f61-acb8-35d9722ac245-multus-daemon-config\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/697065e3-6f8f-43d4-8edb-d9e197403f23-host-slash\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865707    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysconfig\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.865933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865747    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-hosts-file\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865749    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/697065e3-6f8f-43d4-8edb-d9e197403f23-host-slash\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865765    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-system-cni-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865775    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-netns\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865804    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866023    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-etc-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-cni-bin\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.865841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-socket-dir-parent\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866096    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-cni-netd\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-ovnkube-config\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f485b2-9315-4f61-acb8-35d9722ac245-cni-binary-copy\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-modprobe-d\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866249    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhhr\" (UniqueName: \"kubernetes.io/projected/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-kube-api-access-gzhhr\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866271    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-sys-fs\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9kqz\" (UniqueName: \"kubernetes.io/projected/24bc5d53-9d68-49d6-818e-8696a332e04c-kube-api-access-p9kqz\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.866559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc-agent-certs\") pod \"konnectivity-agent-ws8nc\" (UID: \"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc\") " pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866329    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-modprobe-d\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-hostroot\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866348    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/74f485b2-9315-4f61-acb8-35d9722ac245-multus-daemon-config\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866371    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q9bd\" (UniqueName: \"kubernetes.io/projected/74f485b2-9315-4f61-acb8-35d9722ac245-kube-api-access-7q9bd\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866406    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-hostroot\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866413    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866439    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-ovnkube-script-lib\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-registration-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-cnibin\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866508    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-kubelet\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866531    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24t7w\" (UniqueName: \"kubernetes.io/projected/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-kube-api-access-24t7w\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866556    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-kubelet\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866586    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-cni-multus\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f485b2-9315-4f61-acb8-35d9722ac245-cni-binary-copy\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.867275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-lib-modules\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866654    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-systemd-units\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-cni-multus\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-system-cni-dir\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/697065e3-6f8f-43d4-8edb-d9e197403f23-iptables-alerter-script\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-lib-modules\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-log-socket\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-socket-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866908    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-conf-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-kubernetes\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866977    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-kubernetes\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.866970    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-multus-conf-dir\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867014    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867061    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-cnibin\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdad1164-7fe4-4356-904e-3fef58433988-tmp\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867114    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2sxb\" (UniqueName: \"kubernetes.io/projected/da590729-c278-4d83-81b0-2105f798493b-kube-api-access-q2sxb\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-cnibin\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhff\" (UniqueName: \"kubernetes.io/projected/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-kube-api-access-tfhff\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867230    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/697065e3-6f8f-43d4-8edb-d9e197403f23-iptables-alerter-script\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-cni-bin\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-multus-certs\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867281    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jdb7\" (UniqueName: \"kubernetes.io/projected/bdad1164-7fe4-4356-904e-3fef58433988-kube-api-access-4jdb7\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867292    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-var-lib-cni-bin\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-kubelet-config\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867326    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-multus-certs\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-kubelet\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867381    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-slash\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867415    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-run-netns\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-etc-kubernetes\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-host\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-var-lib-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867528    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-etc-kubernetes\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.868612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-host\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70ef2110-78b6-4ecd-b9be-199eb5bee58b-host\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70ef2110-78b6-4ecd-b9be-199eb5bee58b-serviceca\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9gfl\" (UniqueName: \"kubernetes.io/projected/697065e3-6f8f-43d4-8edb-d9e197403f23-kube-api-access-g9gfl\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867652    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70ef2110-78b6-4ecd-b9be-199eb5bee58b-host\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-node-log\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867709    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-k8s-cni-cncf-io\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysctl-conf\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-dbus\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867842    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-systemd\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/74f485b2-9315-4f61-acb8-35d9722ac245-host-run-k8s-cni-cncf-io\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.867927    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bdad1164-7fe4-4356-904e-3fef58433988-etc-sysctl-conf\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.869238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.868013    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70ef2110-78b6-4ecd-b9be-199eb5bee58b-serviceca\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.869932 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.869913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdad1164-7fe4-4356-904e-3fef58433988-tmp\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.870010 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.869950    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bdad1164-7fe4-4356-904e-3fef58433988-etc-tuned\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.878257 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.878232    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:18.878257 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.878258    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:18.878397 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.878272    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7cqsx for pod openshift-network-diagnostics/network-check-target-hmg8r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:18.878397 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.878360    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx podName:fd06631e-6ff3-4790-9717-e0ffdbd16d0e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:19.378333283 +0000 UTC m=+2.928521136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7cqsx" (UniqueName: "kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx") pod "network-check-target-hmg8r" (UID: "fd06631e-6ff3-4790-9717-e0ffdbd16d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:18.879419 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.879397    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcrdt\" (UniqueName: \"kubernetes.io/projected/70ef2110-78b6-4ecd-b9be-199eb5bee58b-kube-api-access-zcrdt\") pod \"node-ca-d6zfb\" (UID: \"70ef2110-78b6-4ecd-b9be-199eb5bee58b\") " pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:18.882473 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.882439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jdb7\" (UniqueName: \"kubernetes.io/projected/bdad1164-7fe4-4356-904e-3fef58433988-kube-api-access-4jdb7\") pod \"tuned-rbn4v\" (UID: \"bdad1164-7fe4-4356-904e-3fef58433988\") " pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:18.882592 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.882579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9gfl\" (UniqueName: \"kubernetes.io/projected/697065e3-6f8f-43d4-8edb-d9e197403f23-kube-api-access-g9gfl\") pod \"iptables-alerter-jnw89\" (UID: \"697065e3-6f8f-43d4-8edb-d9e197403f23\") " pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:18.882718 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.882700    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhff\" (UniqueName: \"kubernetes.io/projected/c5cf08d1-4023-4d0f-b38d-35ba5889a90f-kube-api-access-tfhff\") pod \"node-resolver-npr6z\" (UID: \"c5cf08d1-4023-4d0f-b38d-35ba5889a90f\") " pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:18.884849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.884830    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q9bd\" (UniqueName: \"kubernetes.io/projected/74f485b2-9315-4f61-acb8-35d9722ac245-kube-api-access-7q9bd\") pod \"multus-4s8pm\" (UID: \"74f485b2-9315-4f61-acb8-35d9722ac245\") " pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:18.890944 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.890907    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal" event={"ID":"3d106852fe9cba1c1b928ec423e65e68","Type":"ContainerStarted","Data":"2e399bfc3d6b3638f3f1c9b20a263a4b48b33975e606ccb8425f843ba10994fe"}
Sep 11 16:02:18.892179 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.892151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal" event={"ID":"be16f24f8a338b8813634cec41ddf846","Type":"ContainerStarted","Data":"325e4df30f6c11986681a3acbd9dbcabb82f6226f7b38fe886c57960faa724c3"}
Sep 11 16:02:18.938827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.938796    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:02:18.968596 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968567    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-node-log\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-dbus\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-systemd\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-etc-selinux\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc-konnectivity-ca\") pod \"konnectivity-agent-ws8nc\" (UID: \"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc\") " pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-node-log\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968722    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-dbus\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.968738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968723    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-systemd\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968725    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-ovn\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968771    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-ovn\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968789    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-env-overrides\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-device-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968819    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-etc-selinux\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da590729-c278-4d83-81b0-2105f798493b-ovn-node-metrics-cert\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968892    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-device-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-etc-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968939    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-cni-bin\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.968946    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-cni-netd\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.968989    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-ovnkube-config\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969008    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-etc-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.969006    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret podName:f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc nodeName:}" failed. No retries permitted until 2026-09-11 16:02:19.468988451 +0000 UTC m=+3.019176306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret") pod "global-pull-secret-syncer-xh55j" (UID: "f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969064    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-cni-bin\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969076    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969106    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhhr\" (UniqueName: \"kubernetes.io/projected/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-kube-api-access-gzhhr\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969118    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-cni-netd\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-sys-fs\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9kqz\" (UniqueName: \"kubernetes.io/projected/24bc5d53-9d68-49d6-818e-8696a332e04c-kube-api-access-p9kqz\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969180    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc-agent-certs\") pod \"konnectivity-agent-ws8nc\" (UID: \"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc\") " pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.969197    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969193    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:18.969258    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:19.469242921 +0000 UTC m=+3.019430752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969269    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-sys-fs\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-ovnkube-script-lib\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc-konnectivity-ca\") pod \"konnectivity-agent-ws8nc\" (UID: \"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc\") " pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969346    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-registration-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-cnibin\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-env-overrides\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969407    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-cnibin\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.969930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-run-ovn-kubernetes\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24t7w\" (UniqueName: \"kubernetes.io/projected/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-kube-api-access-24t7w\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-registration-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-systemd-units\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969639    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-system-cni-dir\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-log-socket\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969705    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969732    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-socket-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969759    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24bc5d53-9d68-49d6-818e-8696a332e04c-system-cni-dir\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2sxb\" (UniqueName: \"kubernetes.io/projected/da590729-c278-4d83-81b0-2105f798493b-kube-api-access-q2sxb\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969809    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-systemd-units\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-kubelet-config\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.970743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-run-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-kubelet\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-slash\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-run-netns\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-var-lib-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.969966    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970065    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970138    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-kubelet-config\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-ovnkube-config\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-kubelet\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970222    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-run-netns\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-socket-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-var-lib-openvswitch\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-host-slash\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970364    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/da590729-c278-4d83-81b0-2105f798493b-log-socket\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970391    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-kubelet-dir\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.971445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970709    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24bc5d53-9d68-49d6-818e-8696a332e04c-cni-binary-copy\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.972250 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.970711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/da590729-c278-4d83-81b0-2105f798493b-ovnkube-script-lib\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.972250 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.971450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/da590729-c278-4d83-81b0-2105f798493b-ovn-node-metrics-cert\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.972250 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.972216    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc-agent-certs\") pod \"konnectivity-agent-ws8nc\" (UID: \"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc\") " pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:18.980757 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.980722    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24t7w\" (UniqueName: \"kubernetes.io/projected/0d31e9c2-05d7-409d-b7db-ebe7e2b7f448-kube-api-access-24t7w\") pod \"aws-ebs-csi-driver-node-khb5h\" (UID: \"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:18.983349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.983288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9kqz\" (UniqueName: \"kubernetes.io/projected/24bc5d53-9d68-49d6-818e-8696a332e04c-kube-api-access-p9kqz\") pod \"multus-additional-cni-plugins-jxx4m\" (UID: \"24bc5d53-9d68-49d6-818e-8696a332e04c\") " pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:18.984434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.984413    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2sxb\" (UniqueName: \"kubernetes.io/projected/da590729-c278-4d83-81b0-2105f798493b-kube-api-access-q2sxb\") pod \"ovnkube-node-d9gbr\" (UID: \"da590729-c278-4d83-81b0-2105f798493b\") " pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:18.984533 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:18.984437    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhhr\" (UniqueName: \"kubernetes.io/projected/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-kube-api-access-gzhhr\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:19.054921 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.054892    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rbn4v"
Sep 11 16:02:19.066888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.066869    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-npr6z"
Sep 11 16:02:19.072139 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.072056    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6zfb"
Sep 11 16:02:19.074860 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.074840    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdad1164_7fe4_4356_904e_3fef58433988.slice/crio-342b39cd0d68af90ca4cac4fe830cfce0511e77708516dedc8eb6d1d60b23175 WatchSource:0}: Error finding container 342b39cd0d68af90ca4cac4fe830cfce0511e77708516dedc8eb6d1d60b23175: Status 404 returned error can't find the container with id 342b39cd0d68af90ca4cac4fe830cfce0511e77708516dedc8eb6d1d60b23175
Sep 11 16:02:19.077093 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.077071    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cf08d1_4023_4d0f_b38d_35ba5889a90f.slice/crio-040cf71c5586897252b3362f97b553d65178850b3b447eeb0d8fa60e8ce8e944 WatchSource:0}: Error finding container 040cf71c5586897252b3362f97b553d65178850b3b447eeb0d8fa60e8ce8e944: Status 404 returned error can't find the container with id 040cf71c5586897252b3362f97b553d65178850b3b447eeb0d8fa60e8ce8e944
Sep 11 16:02:19.077956 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.077940    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4s8pm"
Sep 11 16:02:19.081328 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.081306    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ef2110_78b6_4ecd_b9be_199eb5bee58b.slice/crio-efc90b7a5447b424ee2cf32c62c839aca9339b2dabdfbc7d05e306f3b01b70a7 WatchSource:0}: Error finding container efc90b7a5447b424ee2cf32c62c839aca9339b2dabdfbc7d05e306f3b01b70a7: Status 404 returned error can't find the container with id efc90b7a5447b424ee2cf32c62c839aca9339b2dabdfbc7d05e306f3b01b70a7
Sep 11 16:02:19.084615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.084594    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jnw89"
Sep 11 16:02:19.088786 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.088753    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f485b2_9315_4f61_acb8_35d9722ac245.slice/crio-63811840f76a63d3e744f915aaf5ea25c6e8fcdf5da768c7f681467c97bfbd6a WatchSource:0}: Error finding container 63811840f76a63d3e744f915aaf5ea25c6e8fcdf5da768c7f681467c97bfbd6a: Status 404 returned error can't find the container with id 63811840f76a63d3e744f915aaf5ea25c6e8fcdf5da768c7f681467c97bfbd6a
Sep 11 16:02:19.090984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.090909    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h"
Sep 11 16:02:19.097184 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.097165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jxx4m"
Sep 11 16:02:19.097325 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.097306    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697065e3_6f8f_43d4_8edb_d9e197403f23.slice/crio-4fa993f462b2e1667963e347a4b4a56751c25981da8f318c8fe2a6e3f125cb1d WatchSource:0}: Error finding container 4fa993f462b2e1667963e347a4b4a56751c25981da8f318c8fe2a6e3f125cb1d: Status 404 returned error can't find the container with id 4fa993f462b2e1667963e347a4b4a56751c25981da8f318c8fe2a6e3f125cb1d
Sep 11 16:02:19.100087 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.100061    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d31e9c2_05d7_409d_b7db_ebe7e2b7f448.slice/crio-24e2215170b7a70da8f98fbfea037cafc8a82821b533390235e0a28891524624 WatchSource:0}: Error finding container 24e2215170b7a70da8f98fbfea037cafc8a82821b533390235e0a28891524624: Status 404 returned error can't find the container with id 24e2215170b7a70da8f98fbfea037cafc8a82821b533390235e0a28891524624
Sep 11 16:02:19.104214 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.104191    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:19.108025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.108010    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:19.112934 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.112914    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda590729_c278_4d83_81b0_2105f798493b.slice/crio-8bd0fe2c25d5644a7213669d3f229cb90309d0c55bb4cefc7e2f8466f40788be WatchSource:0}: Error finding container 8bd0fe2c25d5644a7213669d3f229cb90309d0c55bb4cefc7e2f8466f40788be: Status 404 returned error can't find the container with id 8bd0fe2c25d5644a7213669d3f229cb90309d0c55bb4cefc7e2f8466f40788be
Sep 11 16:02:19.117997 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:19.117980    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a93f7c_98ff_4c9b_98bb_76a40f9ef7dc.slice/crio-b7024bceffbcc0d3b5c5d00fc3601111f7f27b22dc4f1d81a237c061cd9b519c WatchSource:0}: Error finding container b7024bceffbcc0d3b5c5d00fc3601111f7f27b22dc4f1d81a237c061cd9b519c: Status 404 returned error can't find the container with id b7024bceffbcc0d3b5c5d00fc3601111f7f27b22dc4f1d81a237c061cd9b519c
Sep 11 16:02:19.473320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.473274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:19.473320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.473322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:19.473551 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.473349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:19.473551 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473452    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:19.473551 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473529    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret podName:f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc nodeName:}" failed. No retries permitted until 2026-09-11 16:02:20.473508666 +0000 UTC m=+4.023696497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret") pod "global-pull-secret-syncer-xh55j" (UID: "f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:19.473551 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473457    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:19.473762 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473592    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:20.473580214 +0000 UTC m=+4.023768045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:19.473762 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473462    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:19.473762 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473613    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:19.473762 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473624    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7cqsx for pod openshift-network-diagnostics/network-check-target-hmg8r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:19.473762 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.473651    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx podName:fd06631e-6ff3-4790-9717-e0ffdbd16d0e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:20.47364468 +0000 UTC m=+4.023832511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cqsx" (UniqueName: "kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx") pod "network-check-target-hmg8r" (UID: "fd06631e-6ff3-4790-9717-e0ffdbd16d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:19.803256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.803190    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 15:57:18 +0000 UTC" deadline="2028-06-21 01:59:07.297778008 +0000 UTC"
Sep 11 16:02:19.803256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.803254    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15561h56m47.494528317s"
Sep 11 16:02:19.887132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.887105    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:19.887297 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:19.887224    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:19.904172 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.904143    2557 generic.go:356] "Generic (PLEG): container finished" podID="be16f24f8a338b8813634cec41ddf846" containerID="8b3d542b98e93b7eae428b0fd4a867ed76565e7a4616f841829b2cd577fe0543" exitCode=0
Sep 11 16:02:19.904422 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.904392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal" event={"ID":"be16f24f8a338b8813634cec41ddf846","Type":"ContainerDied","Data":"8b3d542b98e93b7eae428b0fd4a867ed76565e7a4616f841829b2cd577fe0543"}
Sep 11 16:02:19.907508 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.907480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jnw89" event={"ID":"697065e3-6f8f-43d4-8edb-d9e197403f23","Type":"ContainerStarted","Data":"4fa993f462b2e1667963e347a4b4a56751c25981da8f318c8fe2a6e3f125cb1d"}
Sep 11 16:02:19.915177 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.915157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4s8pm" event={"ID":"74f485b2-9315-4f61-acb8-35d9722ac245","Type":"ContainerStarted","Data":"63811840f76a63d3e744f915aaf5ea25c6e8fcdf5da768c7f681467c97bfbd6a"}
Sep 11 16:02:19.920822 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.920793    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-npr6z" event={"ID":"c5cf08d1-4023-4d0f-b38d-35ba5889a90f","Type":"ContainerStarted","Data":"040cf71c5586897252b3362f97b553d65178850b3b447eeb0d8fa60e8ce8e944"}
Sep 11 16:02:19.924738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.924705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rbn4v" event={"ID":"bdad1164-7fe4-4356-904e-3fef58433988","Type":"ContainerStarted","Data":"342b39cd0d68af90ca4cac4fe830cfce0511e77708516dedc8eb6d1d60b23175"}
Sep 11 16:02:19.928622 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.928600    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ws8nc" event={"ID":"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc","Type":"ContainerStarted","Data":"b7024bceffbcc0d3b5c5d00fc3601111f7f27b22dc4f1d81a237c061cd9b519c"}
Sep 11 16:02:19.932428 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.932403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"8bd0fe2c25d5644a7213669d3f229cb90309d0c55bb4cefc7e2f8466f40788be"}
Sep 11 16:02:19.933833 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.933809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerStarted","Data":"67a82ecae48154a0b1c2333b14f3f8791d3b5a88654351d50b524a1c54dfeed7"}
Sep 11 16:02:19.935667 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.935643    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h" event={"ID":"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448","Type":"ContainerStarted","Data":"24e2215170b7a70da8f98fbfea037cafc8a82821b533390235e0a28891524624"}
Sep 11 16:02:19.937025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:19.937005    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6zfb" event={"ID":"70ef2110-78b6-4ecd-b9be-199eb5bee58b","Type":"ContainerStarted","Data":"efc90b7a5447b424ee2cf32c62c839aca9339b2dabdfbc7d05e306f3b01b70a7"}
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.483498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.483553    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.483597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.483727    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.483787    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:22.483770271 +0000 UTC m=+6.033958107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.484180    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.484231    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret podName:f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc nodeName:}" failed. No retries permitted until 2026-09-11 16:02:22.48421615 +0000 UTC m=+6.034403989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret") pod "global-pull-secret-syncer-xh55j" (UID: "f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.484306    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.484320    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.484331    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7cqsx for pod openshift-network-diagnostics/network-check-target-hmg8r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:20.484398 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.484366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx podName:fd06631e-6ff3-4790-9717-e0ffdbd16d0e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:22.484355085 +0000 UTC m=+6.034542920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cqsx" (UniqueName: "kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx") pod "network-check-target-hmg8r" (UID: "fd06631e-6ff3-4790-9717-e0ffdbd16d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:20.804418 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.804323    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 15:57:18 +0000 UTC" deadline="2028-03-06 16:54:41.601840351 +0000 UTC"
Sep 11 16:02:20.804418 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.804367    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13008h52m20.797480301s"
Sep 11 16:02:20.888511 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.888476    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:20.888688 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.888628    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:20.889404 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:20.889212    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:20.889404 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:20.889314    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:21.887177 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:21.887096    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:21.887705 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:21.887232    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:22.503749 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:22.503714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:22.503914 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:22.503763    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:22.503914 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:22.503823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:22.503914 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.503878    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:22.503914 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.503911    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:22.504161 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.503937    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:22.504161 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.503954    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret podName:f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc nodeName:}" failed. No retries permitted until 2026-09-11 16:02:26.503935517 +0000 UTC m=+10.054123363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret") pod "global-pull-secret-syncer-xh55j" (UID: "f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:22.504161 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.504000    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:26.503984445 +0000 UTC m=+10.054172295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:22.504161 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.503929    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:22.504161 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.504026    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7cqsx for pod openshift-network-diagnostics/network-check-target-hmg8r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:22.504161 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.504080    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx podName:fd06631e-6ff3-4790-9717-e0ffdbd16d0e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:26.504067949 +0000 UTC m=+10.054255793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cqsx" (UniqueName: "kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx") pod "network-check-target-hmg8r" (UID: "fd06631e-6ff3-4790-9717-e0ffdbd16d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:22.887685 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:22.886961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:22.887685 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.887166    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:22.888609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:22.888301    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:22.888609 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:22.888479    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:23.887425 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:23.887084    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:23.887425 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:23.887208    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:24.887426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:24.887386    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:24.887863 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:24.887538    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:24.887863 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:24.887584    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:24.887863 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:24.887698    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:25.886592 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:25.886507    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:25.886753 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:25.886638    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:26.541250 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:26.541209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:26.541641 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:26.541274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:26.541641 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:26.541310    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:26.541641 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.541455    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:26.541641 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.541524    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:34.541503798 +0000 UTC m=+18.091691646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:26.541958 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.541934    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:26.542056 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.541997    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret podName:f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc nodeName:}" failed. No retries permitted until 2026-09-11 16:02:34.541980193 +0000 UTC m=+18.092168041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret") pod "global-pull-secret-syncer-xh55j" (UID: "f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:26.542118 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.542071    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:26.542118 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.542094    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:26.542118 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.542107    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7cqsx for pod openshift-network-diagnostics/network-check-target-hmg8r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:26.542258 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.542155    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx podName:fd06631e-6ff3-4790-9717-e0ffdbd16d0e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:34.542140629 +0000 UTC m=+18.092328498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cqsx" (UniqueName: "kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx") pod "network-check-target-hmg8r" (UID: "fd06631e-6ff3-4790-9717-e0ffdbd16d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:26.889182 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:26.888771    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:26.889182 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.888891    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:26.889931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:26.889909    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:26.890061 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:26.889996    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:27.886781 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:27.886752    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:27.887185 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:27.886858    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:28.887305 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:28.887216    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:28.887740 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:28.887372    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:28.887740 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:28.887416    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:28.887740 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:28.887520    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:29.886553 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:29.886519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:29.886729 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:29.886653    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:30.886827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:30.886794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:30.887306 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:30.886921    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:30.887306 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:30.886969    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:30.887306 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:30.887097    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:31.886908 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:31.886867    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:31.887407 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:31.887001    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:32.887126 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:32.887092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:32.887578 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:32.887093    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:32.887578 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:32.887228    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:32.887578 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:32.887301    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:33.887079 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:33.887028    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:33.887272 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:33.887178    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:34.598065 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:34.598017    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:34.598229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:34.598084    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:34.598229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:34.598120    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:34.598229 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598157    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:34.598229 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598228    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret podName:f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc nodeName:}" failed. No retries permitted until 2026-09-11 16:02:50.598207508 +0000 UTC m=+34.148395355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret") pod "global-pull-secret-syncer-xh55j" (UID: "f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:02:34.598443 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598242    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:34.598443 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598247    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:02:34.598443 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598269    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:02:34.598443 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598281    2557 projected.go:196] Error preparing data for projected volume kube-api-access-7cqsx for pod openshift-network-diagnostics/network-check-target-hmg8r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:34.598443 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598291    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:50.598274556 +0000 UTC m=+34.148462388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:02:34.598443 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.598333    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx podName:fd06631e-6ff3-4790-9717-e0ffdbd16d0e nodeName:}" failed. No retries permitted until 2026-09-11 16:02:50.598318566 +0000 UTC m=+34.148506408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cqsx" (UniqueName: "kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx") pod "network-check-target-hmg8r" (UID: "fd06631e-6ff3-4790-9717-e0ffdbd16d0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:02:34.886522 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:34.886437    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:34.886670 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:34.886445    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:34.886670 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.886565    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:34.886670 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:34.886639    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:35.886947 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:35.886916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:35.887328 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:35.887062    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:36.887355 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.887086    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:36.887971 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:36.887423    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:36.887971 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.887120    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:36.887971 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:36.887557    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:36.975371 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.975341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-npr6z" event={"ID":"c5cf08d1-4023-4d0f-b38d-35ba5889a90f","Type":"ContainerStarted","Data":"b1b755994f21b7121a4792511dfb6c3414d7a31f27feb302c904db1d026ea2da"}
Sep 11 16:02:36.976915 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.976889    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rbn4v" event={"ID":"bdad1164-7fe4-4356-904e-3fef58433988","Type":"ContainerStarted","Data":"cc6c7d260d4b03192fdf22644357c3fce1aaea40f6048066a637f063dfb39078"}
Sep 11 16:02:36.978505 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.978483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ws8nc" event={"ID":"14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc","Type":"ContainerStarted","Data":"e4424336362d8b66e04dca4f7940feece81d2ce4ed3062da33e6f268a626d4ec"}
Sep 11 16:02:36.981340 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981322    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:02:36.981696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981679    2557 generic.go:356] "Generic (PLEG): container finished" podID="da590729-c278-4d83-81b0-2105f798493b" containerID="d088ba1c3998b1fedbbeb7f8478d89209893ba1e692f3951d1d1b9a6a0edac06" exitCode=1
Sep 11 16:02:36.981756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981742    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"9c57a853f6d6d59108ff9fd81e0ae23b595068216ceef4f5b9173fd141632194"}
Sep 11 16:02:36.981823 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981799    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"8bc58ce01806190ed9cbee14930378395ee549e1afe903abb94866e255a0d2f7"}
Sep 11 16:02:36.981926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"08fbb7d57c339b8ec589c50bf4f8b83c13d82d943abbfe5a9b1311fb0f859958"}
Sep 11 16:02:36.981926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981885    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"31f3a8d10abde3a824daa5217197b718d442dd015a6231a53ac15994e74f79c7"}
Sep 11 16:02:36.981926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981913    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerDied","Data":"d088ba1c3998b1fedbbeb7f8478d89209893ba1e692f3951d1d1b9a6a0edac06"}
Sep 11 16:02:36.982059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.981949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"6fd8289cc03f7273e019d45c557eb3eafbe921230b46c5dc98a6d2ebb361a285"}
Sep 11 16:02:36.983321 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.983271    2557 generic.go:356] "Generic (PLEG): container finished" podID="24bc5d53-9d68-49d6-818e-8696a332e04c" containerID="a06d433d1a7cfe632923b0dd0fccbeaf0a1d85a26cf4d70f689cb1b78abdeccf" exitCode=0
Sep 11 16:02:36.983416 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.983335    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerDied","Data":"a06d433d1a7cfe632923b0dd0fccbeaf0a1d85a26cf4d70f689cb1b78abdeccf"}
Sep 11 16:02:36.984986 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.984962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h" event={"ID":"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448","Type":"ContainerStarted","Data":"ebd9f0a6cecf097624ca78a0548210e819d88ac301f7e9f8a6482d03ff3f51f7"}
Sep 11 16:02:36.986586 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.986561    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6zfb" event={"ID":"70ef2110-78b6-4ecd-b9be-199eb5bee58b","Type":"ContainerStarted","Data":"54e9ea887795d61558676d3731c9e486e2c5bdcfd5e9e813a0cb1cd05c32b92e"}
Sep 11 16:02:36.988023 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.987995    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal" event={"ID":"3d106852fe9cba1c1b928ec423e65e68","Type":"ContainerStarted","Data":"f3d8db5fb02bef0a3ce9e176137f34df2cf6d162f152519eaf5166f56f51f608"}
Sep 11 16:02:36.989864 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.989841    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal" event={"ID":"be16f24f8a338b8813634cec41ddf846","Type":"ContainerStarted","Data":"f43e82a4d8bc0697b667d47b3df7d33f7eb7ccafb4753242ea6e3e8bf4aef50d"}
Sep 11 16:02:36.991383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.991360    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4s8pm" event={"ID":"74f485b2-9315-4f61-acb8-35d9722ac245","Type":"ContainerStarted","Data":"15311e8b1d7e30a256346ffdb3e4fcdbb4a898576dd78812bf1825a0024e6bd3"}
Sep 11 16:02:36.991460 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:36.991386    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-npr6z" podStartSLOduration=3.864304265 podStartE2EDuration="20.991374392s" totalImagesPullingTime="17.127070127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:36.99074531 +0000 UTC m=+20.540933163" watchObservedRunningTime="2026-09-11 16:02:36.991374392 +0000 UTC m=+20.541562246"
Sep 11 16:02:37.006800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.006743    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ws8nc" podStartSLOduration=2.86983574 podStartE2EDuration="20.006723557s" totalImagesPullingTime="17.136887817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:37.00620908 +0000 UTC m=+20.556396933" watchObservedRunningTime="2026-09-11 16:02:37.006723557 +0000 UTC m=+20.556911411"
Sep 11 16:02:37.020957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.020899    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-241.ec2.internal" podStartSLOduration=20.02088432 podStartE2EDuration="20.02088432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:37.020420009 +0000 UTC m=+20.570607868" watchObservedRunningTime="2026-09-11 16:02:37.02088432 +0000 UTC m=+20.571072173"
Sep 11 16:02:37.038976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.038933    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rbn4v" podStartSLOduration=3.823214322 podStartE2EDuration="21.038920572s" totalImagesPullingTime="17.21570625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:37.038360454 +0000 UTC m=+20.588548307" watchObservedRunningTime="2026-09-11 16:02:37.038920572 +0000 UTC m=+20.589108425"
Sep 11 16:02:37.069606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.069509    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d6zfb" podStartSLOduration=3.862628179 podStartE2EDuration="21.069490959s" totalImagesPullingTime="17.20686278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:37.053236278 +0000 UTC m=+20.603424130" watchObservedRunningTime="2026-09-11 16:02:37.069490959 +0000 UTC m=+20.619678812"
Sep 11 16:02:37.069713 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.069656    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-241.ec2.internal" podStartSLOduration=20.069648508 podStartE2EDuration="20.069648508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:37.069427101 +0000 UTC m=+20.619614953" watchObservedRunningTime="2026-09-11 16:02:37.069648508 +0000 UTC m=+20.619836360"
Sep 11 16:02:37.432866 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.432723    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 16:02:37.822344 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.822249    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T16:02:37.432856938Z","UUID":"e0e090d5-254e-4634-9d98-63287c698fa3","Handler":null,"Name":"","Endpoint":""}
Sep 11 16:02:37.823650 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.823632    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 16:02:37.823767 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.823663    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 16:02:37.886981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.886949    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:37.887158 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:37.887090    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:37.996089 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.996037    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h" event={"ID":"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448","Type":"ContainerStarted","Data":"3b63b4260c1e0cd2bd3b101752081dd6f98a608ae3da75da3924daf7adc4a475"}
Sep 11 16:02:37.998057 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:37.998016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jnw89" event={"ID":"697065e3-6f8f-43d4-8edb-d9e197403f23","Type":"ContainerStarted","Data":"20888f93a8d2d11631bf86b45dde44791c97732c04c88bbfee2cd677b5bec946"}
Sep 11 16:02:38.018397 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:38.018311    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4s8pm" podStartSLOduration=4.5407739320000005 podStartE2EDuration="22.01828899s" totalImagesPullingTime="17.477515058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:37.11115258 +0000 UTC m=+20.661340434" watchObservedRunningTime="2026-09-11 16:02:38.01828899 +0000 UTC m=+21.568476843"
Sep 11 16:02:38.018530 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:38.018490    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jnw89" podStartSLOduration=8.927027774999999 podStartE2EDuration="22.018484597s" totalImagesPullingTime="13.091456822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:38.018143859 +0000 UTC m=+21.568331715" watchObservedRunningTime="2026-09-11 16:02:38.018484597 +0000 UTC m=+21.568672449"
Sep 11 16:02:38.886874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:38.886784    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:38.887414 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:38.886936    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:38.887414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:38.886790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:38.887414 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:38.887037    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:39.886896 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:39.886856    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:39.887266 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:39.887014    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:40.006314 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:40.006277    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:02:40.006794 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:40.006765    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"34b5370eb5b84165428b89e3fbd2f720f7bbaa77aaa07f4e3db03faeff02edc6"}
Sep 11 16:02:40.009152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:40.009126    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h" event={"ID":"0d31e9c2-05d7-409d-b7db-ebe7e2b7f448","Type":"ContainerStarted","Data":"c07b58daa4554e0deb94ad1f734addfa54d28f81e6bd983acee6b00a8235616e"}
Sep 11 16:02:40.030447 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:40.030398    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-khb5h" podStartSLOduration=8.244224395 podStartE2EDuration="24.030383786s" totalImagesPullingTime="15.786159391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:40.029896306 +0000 UTC m=+23.580084162" watchObservedRunningTime="2026-09-11 16:02:40.030383786 +0000 UTC m=+23.580571638"
Sep 11 16:02:40.886745 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:40.886711    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:40.887001 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:40.886711    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:40.887001 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:40.886853    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:40.887001 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:40.886914    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:41.855218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:41.855068    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:41.855572 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:41.855554    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:41.886610 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:41.886592    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:41.886698 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:41.886673    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:42.015033 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.014963    2557 generic.go:356] "Generic (PLEG): container finished" podID="24bc5d53-9d68-49d6-818e-8696a332e04c" containerID="c80d55598d859f68443058b4465da2bb7ad0a7269e5fe2eb9f9cbe5568b7a644" exitCode=0
Sep 11 16:02:42.015632 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.015065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerDied","Data":"c80d55598d859f68443058b4465da2bb7ad0a7269e5fe2eb9f9cbe5568b7a644"}
Sep 11 16:02:42.025737 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.023385    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:02:42.026165 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.026135    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"af2dabdd31c86e2b4840bdc73024cfda0e9db062549f56f0145990b38e2d00d5"}
Sep 11 16:02:42.026427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.026394    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:42.026606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.026590    2557 scope.go:117] "RemoveContainer" containerID="d088ba1c3998b1fedbbeb7f8478d89209893ba1e692f3951d1d1b9a6a0edac06"
Sep 11 16:02:42.026753 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.026741    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ws8nc"
Sep 11 16:02:42.886611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.886581    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:42.886782 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:42.886707    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:42.886782 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:42.886756    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:42.886883 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:42.886859    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:43.032020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.031994    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:02:43.032598 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.032418    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" event={"ID":"da590729-c278-4d83-81b0-2105f798493b","Type":"ContainerStarted","Data":"abbfaa5076f938d8d6f052978d1dbc6767e5c72a1c84c9e597aa1eaf42ec3be8"}
Sep 11 16:02:43.032659 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.032626    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:43.032713 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.032705    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:43.032764 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.032755    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:43.047972 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.047953    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:43.048118 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.048104    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:02:43.077699 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.077376    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr" podStartSLOduration=8.899809499 podStartE2EDuration="26.0773556s" totalImagesPullingTime="17.177546101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:43.0766139 +0000 UTC m=+26.626801753" watchObservedRunningTime="2026-09-11 16:02:43.0773556 +0000 UTC m=+26.627543461"
Sep 11 16:02:43.374874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.374709    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xh55j"]
Sep 11 16:02:43.375090 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.374997    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:43.375172 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:43.375134    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:43.378992 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.378965    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmg8r"]
Sep 11 16:02:43.379119 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.379082    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:43.379185 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:43.379166    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:43.379606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.379576    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b2ggg"]
Sep 11 16:02:43.379727 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:43.379676    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:43.379787 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:43.379748    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:44.036075 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:44.036022    2557 generic.go:356] "Generic (PLEG): container finished" podID="24bc5d53-9d68-49d6-818e-8696a332e04c" containerID="dd1c23409df5eeaf9dd613cc554c85dccb99bf937157eb54b4d432589cd32fbc" exitCode=0
Sep 11 16:02:44.036443 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:44.036093    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerDied","Data":"dd1c23409df5eeaf9dd613cc554c85dccb99bf937157eb54b4d432589cd32fbc"}
Sep 11 16:02:44.886758 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:44.886733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:44.886758 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:44.886756    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:44.886939 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:44.886858    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:44.886939 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:44.886903    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:44.886939 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:44.886932    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:44.887066 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:44.886987    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:45.040033 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:45.039953    2557 generic.go:356] "Generic (PLEG): container finished" podID="24bc5d53-9d68-49d6-818e-8696a332e04c" containerID="3ac7a110480455a5a6869338179f05fc2dc8b681721bff4741fc904a6975be0c" exitCode=0
Sep 11 16:02:45.040412 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:45.040040    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerDied","Data":"3ac7a110480455a5a6869338179f05fc2dc8b681721bff4741fc904a6975be0c"}
Sep 11 16:02:46.888065 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:46.888011    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:46.888477 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:46.888119    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:46.888477 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:46.888128    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xh55j" podUID="f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc"
Sep 11 16:02:46.888477 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:46.888257    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b2ggg" podUID="3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4"
Sep 11 16:02:46.888477 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:46.888303    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:46.888477 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:46.888436    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmg8r" podUID="fd06631e-6ff3-4790-9717-e0ffdbd16d0e"
Sep 11 16:02:48.189358 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.189328    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-241.ec2.internal" event="NodeReady"
Sep 11 16:02:48.189725 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.189488    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 16:02:48.256742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.256671    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dpqst"]
Sep 11 16:02:48.292804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.292774    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-g4v2m"]
Sep 11 16:02:48.292976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.292931    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.297836 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.297808    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 16:02:48.300883 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.300860    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 16:02:48.300988 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.300954    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gkgdt\""
Sep 11 16:02:48.304483 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.301557    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 16:02:48.314680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.314659    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dpqst"]
Sep 11 16:02:48.314680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.314688    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4v2m"]
Sep 11 16:02:48.314889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.314792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.318258 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.318242    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 16:02:48.318906 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.318886    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lgnfp\""
Sep 11 16:02:48.318993 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.318978    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 16:02:48.405722 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.405689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzm9k\" (UniqueName: \"kubernetes.io/projected/1d74b7d8-e76a-4b61-8059-3f210cbc9087-kube-api-access-jzm9k\") pod \"ingress-canary-dpqst\" (UID: \"1d74b7d8-e76a-4b61-8059-3f210cbc9087\") " pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.405886 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.405737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmgz4\" (UniqueName: \"kubernetes.io/projected/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-kube-api-access-fmgz4\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.405886 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.405768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d74b7d8-e76a-4b61-8059-3f210cbc9087-cert\") pod \"ingress-canary-dpqst\" (UID: \"1d74b7d8-e76a-4b61-8059-3f210cbc9087\") " pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.405886 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.405851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-tmp-dir\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.405886 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.405874    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.406025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.405900    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-config-volume\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.506697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.506662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-tmp-dir\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.506913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.506773    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.506913 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:48.506811    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:48.506913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.506832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-config-volume\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.506913 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:48.506872    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls podName:efcfec48-1d15-49cd-bb60-b691f8cfa9b3 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:49.006854243 +0000 UTC m=+32.557042074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls") pod "dns-default-g4v2m" (UID: "efcfec48-1d15-49cd-bb60-b691f8cfa9b3") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:48.506913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.506890    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzm9k\" (UniqueName: \"kubernetes.io/projected/1d74b7d8-e76a-4b61-8059-3f210cbc9087-kube-api-access-jzm9k\") pod \"ingress-canary-dpqst\" (UID: \"1d74b7d8-e76a-4b61-8059-3f210cbc9087\") " pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.507213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.506933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmgz4\" (UniqueName: \"kubernetes.io/projected/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-kube-api-access-fmgz4\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.507213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.506959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d74b7d8-e76a-4b61-8059-3f210cbc9087-cert\") pod \"ingress-canary-dpqst\" (UID: \"1d74b7d8-e76a-4b61-8059-3f210cbc9087\") " pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.507213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.507101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-tmp-dir\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.507566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.507354    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-config-volume\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.511619 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.511501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d74b7d8-e76a-4b61-8059-3f210cbc9087-cert\") pod \"ingress-canary-dpqst\" (UID: \"1d74b7d8-e76a-4b61-8059-3f210cbc9087\") " pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.520056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.519999    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmgz4\" (UniqueName: \"kubernetes.io/projected/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-kube-api-access-fmgz4\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:48.520583 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.520560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzm9k\" (UniqueName: \"kubernetes.io/projected/1d74b7d8-e76a-4b61-8059-3f210cbc9087-kube-api-access-jzm9k\") pod \"ingress-canary-dpqst\" (UID: \"1d74b7d8-e76a-4b61-8059-3f210cbc9087\") " pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.603529 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.603484    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dpqst"
Sep 11 16:02:48.887030 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.886991    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:48.887219 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.886997    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:48.887219 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.887197    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:48.890010 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.889984    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:02:48.890141 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.890014    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:02:48.890141 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.890075    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:02:48.890141 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.890014    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tt876\""
Sep 11 16:02:48.890986 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.890965    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:02:48.891110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:48.891005    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkwl5\""
Sep 11 16:02:49.010667 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:49.010638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:49.010795 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:49.010763    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:49.010853 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:49.010840    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls podName:efcfec48-1d15-49cd-bb60-b691f8cfa9b3 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:50.010820523 +0000 UTC m=+33.561008374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls") pod "dns-default-g4v2m" (UID: "efcfec48-1d15-49cd-bb60-b691f8cfa9b3") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:49.275853 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:49.275831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dpqst"]
Sep 11 16:02:49.278190 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:49.278167    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d74b7d8_e76a_4b61_8059_3f210cbc9087.slice/crio-bbe97af2e076ba36aca71d81dcc190b698261f7e44f2289401e307666be502c0 WatchSource:0}: Error finding container bbe97af2e076ba36aca71d81dcc190b698261f7e44f2289401e307666be502c0: Status 404 returned error can't find the container with id bbe97af2e076ba36aca71d81dcc190b698261f7e44f2289401e307666be502c0
Sep 11 16:02:50.016445 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.016406    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:50.016589 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:50.016556    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:50.016652 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:50.016622    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls podName:efcfec48-1d15-49cd-bb60-b691f8cfa9b3 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:52.016603193 +0000 UTC m=+35.566791024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls") pod "dns-default-g4v2m" (UID: "efcfec48-1d15-49cd-bb60-b691f8cfa9b3") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:50.059550 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.059516    2557 generic.go:356] "Generic (PLEG): container finished" podID="24bc5d53-9d68-49d6-818e-8696a332e04c" containerID="ed6bf13523431d03dd44e39310c3756b43a14165a2754e1da617da4c582169bf" exitCode=0
Sep 11 16:02:50.059704 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.059612    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerDied","Data":"ed6bf13523431d03dd44e39310c3756b43a14165a2754e1da617da4c582169bf"}
Sep 11 16:02:50.061015 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.060993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dpqst" event={"ID":"1d74b7d8-e76a-4b61-8059-3f210cbc9087","Type":"ContainerStarted","Data":"bbe97af2e076ba36aca71d81dcc190b698261f7e44f2289401e307666be502c0"}
Sep 11 16:02:50.620329 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.620296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:50.620967 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.620342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:50.620967 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.620374    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:02:50.620967 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:50.620475    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 16:02:50.620967 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:50.620529    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs podName:3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:22.620513564 +0000 UTC m=+66.170701397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs") pod "network-metrics-daemon-b2ggg" (UID: "3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4") : secret "metrics-daemon-secret" not found
Sep 11 16:02:50.623228 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.623196    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc-original-pull-secret\") pod \"global-pull-secret-syncer-xh55j\" (UID: \"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc\") " pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:50.623530 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.623501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqsx\" (UniqueName: \"kubernetes.io/projected/fd06631e-6ff3-4790-9717-e0ffdbd16d0e-kube-api-access-7cqsx\") pod \"network-check-target-hmg8r\" (UID: \"fd06631e-6ff3-4790-9717-e0ffdbd16d0e\") " pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:50.706969 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.706939    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:50.713108 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:50.713079    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xh55j"
Sep 11 16:02:51.005063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:51.004793    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmg8r"]
Sep 11 16:02:51.034497 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:51.034471    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xh55j"]
Sep 11 16:02:51.067976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:51.067939    2557 generic.go:356] "Generic (PLEG): container finished" podID="24bc5d53-9d68-49d6-818e-8696a332e04c" containerID="174d4909415b381fedc221d2e8de429259bd9e7c8e2308d4fd50804c9b6eb662" exitCode=0
Sep 11 16:02:51.068101 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:51.067997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerDied","Data":"174d4909415b381fedc221d2e8de429259bd9e7c8e2308d4fd50804c9b6eb662"}
Sep 11 16:02:51.619766 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:51.619736    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd06631e_6ff3_4790_9717_e0ffdbd16d0e.slice/crio-5813705552eeaa920b08b2f7c64f2c368d8c7958540179ce8d5993f43cb334d6 WatchSource:0}: Error finding container 5813705552eeaa920b08b2f7c64f2c368d8c7958540179ce8d5993f43cb334d6: Status 404 returned error can't find the container with id 5813705552eeaa920b08b2f7c64f2c368d8c7958540179ce8d5993f43cb334d6
Sep 11 16:02:51.620512 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:02:51.620441    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f1e729_f8fd_4c9c_a481_c2c58b8cb1cc.slice/crio-c03cc6ce284db8a44c30bd935175bb248c9f8bbf73076ef5b3fda04cb46dc6a3 WatchSource:0}: Error finding container c03cc6ce284db8a44c30bd935175bb248c9f8bbf73076ef5b3fda04cb46dc6a3: Status 404 returned error can't find the container with id c03cc6ce284db8a44c30bd935175bb248c9f8bbf73076ef5b3fda04cb46dc6a3
Sep 11 16:02:52.032199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.032169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:52.032366 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:52.032285    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:52.032366 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:52.032346    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls podName:efcfec48-1d15-49cd-bb60-b691f8cfa9b3 nodeName:}" failed. No retries permitted until 2026-09-11 16:02:56.032331037 +0000 UTC m=+39.582518868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls") pod "dns-default-g4v2m" (UID: "efcfec48-1d15-49cd-bb60-b691f8cfa9b3") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:52.072203 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.072157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dpqst" event={"ID":"1d74b7d8-e76a-4b61-8059-3f210cbc9087","Type":"ContainerStarted","Data":"74e98bc2085368cd18af5a10066c380478437e66271109af8e150e0328be1384"}
Sep 11 16:02:52.073485 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.073455    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xh55j" event={"ID":"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc","Type":"ContainerStarted","Data":"c03cc6ce284db8a44c30bd935175bb248c9f8bbf73076ef5b3fda04cb46dc6a3"}
Sep 11 16:02:52.076868 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.076840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" event={"ID":"24bc5d53-9d68-49d6-818e-8696a332e04c","Type":"ContainerStarted","Data":"5d0871c21ba6d6c3ce2123ab6d70caec4ad6c5c834d8761d175d563e4d6a83c2"}
Sep 11 16:02:52.077996 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.077976    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmg8r" event={"ID":"fd06631e-6ff3-4790-9717-e0ffdbd16d0e","Type":"ContainerStarted","Data":"5813705552eeaa920b08b2f7c64f2c368d8c7958540179ce8d5993f43cb334d6"}
Sep 11 16:02:52.091728 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.091684    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dpqst" podStartSLOduration=1.541591264 podStartE2EDuration="4.091671366s" totalImagesPullingTime="2.550080102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:52.090216211 +0000 UTC m=+35.640404062" watchObservedRunningTime="2026-09-11 16:02:52.091671366 +0000 UTC m=+35.641859218"
Sep 11 16:02:52.121854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:52.121799    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jxx4m" podStartSLOduration=7.431688985 podStartE2EDuration="35.12177991s" totalImagesPullingTime="27.690090925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:52.120432654 +0000 UTC m=+35.670620506" watchObservedRunningTime="2026-09-11 16:02:52.12177991 +0000 UTC m=+35.671967763"
Sep 11 16:02:56.064923 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:56.064747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:02:56.065353 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:56.064941    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:02:56.065353 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:02:56.065019    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls podName:efcfec48-1d15-49cd-bb60-b691f8cfa9b3 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:04.065002091 +0000 UTC m=+47.615189923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls") pod "dns-default-g4v2m" (UID: "efcfec48-1d15-49cd-bb60-b691f8cfa9b3") : secret "dns-default-metrics-tls" not found
Sep 11 16:02:57.093321 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:57.093232    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmg8r" event={"ID":"fd06631e-6ff3-4790-9717-e0ffdbd16d0e","Type":"ContainerStarted","Data":"f912a77ba098af90aee0f88abd0bea27afa034570c7986f49a00048b43522d6a"}
Sep 11 16:02:57.093695 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:57.093327    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:02:57.094803 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:57.094778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xh55j" event={"ID":"f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc","Type":"ContainerStarted","Data":"6c71cb207d17195268f05b09461ac311099ec53e83b976f56bc87b8089e55425"}
Sep 11 16:02:57.113811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:57.113764    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hmg8r" podStartSLOduration=35.877349377 podStartE2EDuration="41.11375183s" totalImagesPullingTime="5.236402453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:57.112370881 +0000 UTC m=+40.662558745" watchObservedRunningTime="2026-09-11 16:02:57.11375183 +0000 UTC m=+40.663939682"
Sep 11 16:02:57.129738 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:02:57.129692    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xh55j" podStartSLOduration=34.883112167 podStartE2EDuration="40.129676728s" totalImagesPullingTime="5.246564561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:02:57.128619513 +0000 UTC m=+40.678807365" watchObservedRunningTime="2026-09-11 16:02:57.129676728 +0000 UTC m=+40.679864580"
Sep 11 16:03:01.222669 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.222636    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"]
Sep 11 16:03:01.255614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.255587    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"]
Sep 11 16:03:01.255751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.255678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.259069 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.259033    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 16:03:01.260174 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.260148    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 16:03:01.260174 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.260159    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 16:03:01.260329 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.260290    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 16:03:01.260329 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.260289    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n657h\""
Sep 11 16:03:01.328643 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.328612    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"]
Sep 11 16:03:01.350408 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.350376    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"]
Sep 11 16:03:01.350574 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.350511    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:01.352971 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.352950    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 16:03:01.353222 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.353201    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vh2tm\""
Sep 11 16:03:01.353402 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.353202    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:03:01.353402 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.353207    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 16:03:01.366667 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.366639    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-769b995cc4-mf8xv"]
Sep 11 16:03:01.366845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.366829    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.370115 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.370094    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 16:03:01.370207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.370188    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 16:03:01.370263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.370215    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nmpth\""
Sep 11 16:03:01.370263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.370194    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:03:01.370500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.370486    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 16:03:01.389075 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.389031    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"]
Sep 11 16:03:01.389215 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.389089    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"]
Sep 11 16:03:01.389215 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.389108    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-769b995cc4-mf8xv"]
Sep 11 16:03:01.389215 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.389123    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.391349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391330    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 16:03:01.391444 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391356    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jsw8x\""
Sep 11 16:03:01.391444 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391427    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 16:03:01.391650 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391634    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 16:03:01.391723 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391709    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 16:03:01.391853 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391839    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 16:03:01.391943 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.391925    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 16:03:01.397931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.397913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nblb4\" (UniqueName: \"kubernetes.io/projected/e339260b-512e-48e1-a994-d1d01ccc80e0-kube-api-access-nblb4\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.398025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.397939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.398025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.397959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e339260b-512e-48e1-a994-d1d01ccc80e0-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.446488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.446400    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8fc4b44c-znwsd"]
Sep 11 16:03:01.470756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.470722    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.476943 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.476920    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 16:03:01.477207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.477192    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4k2h9\""
Sep 11 16:03:01.483870 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.483850    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 16:03:01.485191 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.485162    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8fc4b44c-znwsd"]
Sep 11 16:03:01.499052 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d471cb1-4993-4cce-904c-c99b021b6975-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.499138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nblb4\" (UniqueName: \"kubernetes.io/projected/e339260b-512e-48e1-a994-d1d01ccc80e0-kube-api-access-nblb4\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.499138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbd69\" (UniqueName: \"kubernetes.io/projected/2d471cb1-4993-4cce-904c-c99b021b6975-kube-api-access-gbd69\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.499207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.499207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.499312 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499212    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.499312 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499239    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e339260b-512e-48e1-a994-d1d01ccc80e0-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.499312 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.499242    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:01.499312 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499267    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:01.499312 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.499304    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls podName:e339260b-512e-48e1-a994-d1d01ccc80e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:01.999285326 +0000 UTC m=+45.549473161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5c8l7" (UID: "e339260b-512e-48e1-a994-d1d01ccc80e0") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:01.499488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm2k2\" (UniqueName: \"kubernetes.io/projected/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-kube-api-access-sm2k2\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.499488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499360    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d471cb1-4993-4cce-904c-c99b021b6975-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.499488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cbpp\" (UniqueName: \"kubernetes.io/projected/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-kube-api-access-2cbpp\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:01.499488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-default-certificate\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.499488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-stats-auth\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.499905 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.499888    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e339260b-512e-48e1-a994-d1d01ccc80e0-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.504061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.504035    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 16:03:01.519454 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.519431    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 16:03:01.519889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.519872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nblb4\" (UniqueName: \"kubernetes.io/projected/e339260b-512e-48e1-a994-d1d01ccc80e0-kube-api-access-nblb4\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:01.600430 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d471cb1-4993-4cce-904c-c99b021b6975-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.600430 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbd69\" (UniqueName: \"kubernetes.io/projected/2d471cb1-4993-4cce-904c-c99b021b6975-kube-api-access-gbd69\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.600674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af783023-2976-4b5e-941b-e969e9dec533-ca-trust-extracted\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.600674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-registry-certificates\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.600674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600572    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.600674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.600674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz9k6\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-kube-api-access-tz9k6\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.600674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-trusted-ca\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-installation-pull-secrets\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.600717    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.600730    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:02.100710825 +0000 UTC m=+45.650898660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : configmap references non-existent config key: service-ca.crt
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.600778    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:02.100767133 +0000 UTC m=+45.650954969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : secret "router-metrics-certs-default" not found
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.600787    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm2k2\" (UniqueName: \"kubernetes.io/projected/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-kube-api-access-sm2k2\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.600847    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls podName:65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a nodeName:}" failed. No retries permitted until 2026-09-11 16:03:02.100835019 +0000 UTC m=+45.651022873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wgtl8" (UID: "65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a") : secret "samples-operator-tls" not found
Sep 11 16:03:01.600910 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600896    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d471cb1-4993-4cce-904c-c99b021b6975-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-bound-sa-token\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cbpp\" (UniqueName: \"kubernetes.io/projected/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-kube-api-access-2cbpp\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600941    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2d471cb1-4993-4cce-904c-c99b021b6975-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.600953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-image-registry-private-configuration\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.601015    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-default-certificate\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.601065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-stats-auth\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.601325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.601093    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.603109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.603079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2d471cb1-4993-4cce-904c-c99b021b6975-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.603334 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.603318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-stats-auth\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.603401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.603337    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-default-certificate\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.612252 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.612232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm2k2\" (UniqueName: \"kubernetes.io/projected/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-kube-api-access-sm2k2\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:01.612429 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.612412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbd69\" (UniqueName: \"kubernetes.io/projected/2d471cb1-4993-4cce-904c-c99b021b6975-kube-api-access-gbd69\") pod \"kube-storage-version-migrator-operator-6c8f84f897-86k7x\" (UID: \"2d471cb1-4993-4cce-904c-c99b021b6975\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.612630 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.612606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cbpp\" (UniqueName: \"kubernetes.io/projected/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-kube-api-access-2cbpp\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:01.674769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.674735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"
Sep 11 16:03:01.701504 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-bound-sa-token\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.701504 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-image-registry-private-configuration\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.701504 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701558    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af783023-2976-4b5e-941b-e969e9dec533-ca-trust-extracted\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701574    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-registry-certificates\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz9k6\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-kube-api-access-tz9k6\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-trusted-ca\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.701683    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.701698    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc4b44c-znwsd: secret "image-registry-tls" not found
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:01.701762    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls podName:af783023-2976-4b5e-941b-e969e9dec533 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:02.201742603 +0000 UTC m=+45.751930442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls") pod "image-registry-8fc4b44c-znwsd" (UID: "af783023-2976-4b5e-941b-e969e9dec533") : secret "image-registry-tls" not found
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-installation-pull-secrets\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.701997    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af783023-2976-4b5e-941b-e969e9dec533-ca-trust-extracted\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702489 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.702315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-registry-certificates\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.702536 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.702519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-trusted-ca\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.703812 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.703792    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-image-registry-private-configuration\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.704111 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.704090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-installation-pull-secrets\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.711922 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.711901    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-bound-sa-token\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.712189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.712174    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz9k6\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-kube-api-access-tz9k6\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:01.970619 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:01.970543    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x"]
Sep 11 16:03:01.973482 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:01.973457    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d471cb1_4993_4cce_904c_c99b021b6975.slice/crio-abbe62cdbcd96e3176a8bab7c6038c609458312330df245fd1cbc8774ba99728 WatchSource:0}: Error finding container abbe62cdbcd96e3176a8bab7c6038c609458312330df245fd1cbc8774ba99728: Status 404 returned error can't find the container with id abbe62cdbcd96e3176a8bab7c6038c609458312330df245fd1cbc8774ba99728
Sep 11 16:03:02.004382 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:02.004352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:02.004514 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.004496    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:02.004566 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.004557    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls podName:e339260b-512e-48e1-a994-d1d01ccc80e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:03.004541048 +0000 UTC m=+46.554728896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5c8l7" (UID: "e339260b-512e-48e1-a994-d1d01ccc80e0") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:02.104750 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:02.104715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:02.104750 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:02.104749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:02.104976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:02.104771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:02.104976 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.104873    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:03:02.104976 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.104898    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 16:03:02.104976 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.104961    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls podName:65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a nodeName:}" failed. No retries permitted until 2026-09-11 16:03:03.104932194 +0000 UTC m=+46.655120056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wgtl8" (UID: "65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a") : secret "samples-operator-tls" not found
Sep 11 16:03:02.104976 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.104974    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:03.104968266 +0000 UTC m=+46.655156098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : secret "router-metrics-certs-default" not found
Sep 11 16:03:02.105228 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.105001    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:03.104980248 +0000 UTC m=+46.655168099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : configmap references non-existent config key: service-ca.crt
Sep 11 16:03:02.107695 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:02.107675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x" event={"ID":"2d471cb1-4993-4cce-904c-c99b021b6975","Type":"ContainerStarted","Data":"abbe62cdbcd96e3176a8bab7c6038c609458312330df245fd1cbc8774ba99728"}
Sep 11 16:03:02.205362 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:02.205332    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:02.205508 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.205489    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:03:02.205552 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.205510    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc4b44c-znwsd: secret "image-registry-tls" not found
Sep 11 16:03:02.205584 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:02.205564    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls podName:af783023-2976-4b5e-941b-e969e9dec533 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:03.205548936 +0000 UTC m=+46.755736768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls") pod "image-registry-8fc4b44c-znwsd" (UID: "af783023-2976-4b5e-941b-e969e9dec533") : secret "image-registry-tls" not found
Sep 11 16:03:03.013861 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:03.013819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:03.014302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.013968    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:03.014302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.014029    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls podName:e339260b-512e-48e1-a994-d1d01ccc80e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:05.014012762 +0000 UTC m=+48.564200601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5c8l7" (UID: "e339260b-512e-48e1-a994-d1d01ccc80e0") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:03.115055 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:03.115012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:03.115206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:03.115132    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:03.115206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:03.115154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:03.115206 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.115155    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 16:03:03.115302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.115215    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls podName:65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a nodeName:}" failed. No retries permitted until 2026-09-11 16:03:05.115196675 +0000 UTC m=+48.665384511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wgtl8" (UID: "65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a") : secret "samples-operator-tls" not found
Sep 11 16:03:03.115302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.115234    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:03:03.115302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.115268    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:05.115254695 +0000 UTC m=+48.665442527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : configmap references non-existent config key: service-ca.crt
Sep 11 16:03:03.115302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.115289    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:05.115282267 +0000 UTC m=+48.665470098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : secret "router-metrics-certs-default" not found
Sep 11 16:03:03.216061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:03.216009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:03.216210 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.216167    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:03:03.216210 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.216184    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc4b44c-znwsd: secret "image-registry-tls" not found
Sep 11 16:03:03.216292 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:03.216242    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls podName:af783023-2976-4b5e-941b-e969e9dec533 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:05.216226283 +0000 UTC m=+48.766414153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls") pod "image-registry-8fc4b44c-znwsd" (UID: "af783023-2976-4b5e-941b-e969e9dec533") : secret "image-registry-tls" not found
Sep 11 16:03:04.122493 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:04.122463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:03:04.122865 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:04.122574    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:03:04.122865 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:04.122622    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls podName:efcfec48-1d15-49cd-bb60-b691f8cfa9b3 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:20.122609942 +0000 UTC m=+63.672797773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls") pod "dns-default-g4v2m" (UID: "efcfec48-1d15-49cd-bb60-b691f8cfa9b3") : secret "dns-default-metrics-tls" not found
Sep 11 16:03:05.029499 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.029460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:05.029669 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.029621    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:05.029713 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.029682    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls podName:e339260b-512e-48e1-a994-d1d01ccc80e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.029666465 +0000 UTC m=+52.579854311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5c8l7" (UID: "e339260b-512e-48e1-a994-d1d01ccc80e0") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:05.130271 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.130241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.130283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.130318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.130403    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.130382111 +0000 UTC m=+52.680569953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : configmap references non-existent config key: service-ca.crt
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.130445    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.130465    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.130490    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.130478299 +0000 UTC m=+52.680666143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : secret "router-metrics-certs-default" not found
Sep 11 16:03:05.130683 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.130517    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls podName:65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.130501831 +0000 UTC m=+52.680689679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wgtl8" (UID: "65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a") : secret "samples-operator-tls" not found
Sep 11 16:03:05.231329 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.231287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:05.231508 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.231465    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:03:05.231508 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.231492    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc4b44c-znwsd: secret "image-registry-tls" not found
Sep 11 16:03:05.231616 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.231564    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls podName:af783023-2976-4b5e-941b-e969e9dec533 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.23154315 +0000 UTC m=+52.781731001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls") pod "image-registry-8fc4b44c-znwsd" (UID: "af783023-2976-4b5e-941b-e969e9dec533") : secret "image-registry-tls" not found
Sep 11 16:03:05.630264 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.630233    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s9pmn"]
Sep 11 16:03:05.652960 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.652929    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.654135 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.654104    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s9pmn"]
Sep 11 16:03:05.655649 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.655627    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 16:03:05.656188 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.656164    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 16:03:05.656284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.656213    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krpkn\""
Sep 11 16:03:05.656284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.656235    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 16:03:05.656680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.656661    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 16:03:05.835291 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.835254    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6snh\" (UniqueName: \"kubernetes.io/projected/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-api-access-f6snh\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.835291 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.835289    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c029a75a-d221-4913-9758-e5cffc9a3e04-data-volume\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.835540 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.835339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.835540 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.835356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.835540 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.835406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c029a75a-d221-4913-9758-e5cffc9a3e04-crio-socket\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.936730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.936654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6snh\" (UniqueName: \"kubernetes.io/projected/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-api-access-f6snh\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.936730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.936696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c029a75a-d221-4913-9758-e5cffc9a3e04-data-volume\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.936931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.936760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.936931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.936782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.936931 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.936850    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:05.936931 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.936875    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:05.936931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.936902    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c029a75a-d221-4913-9758-e5cffc9a3e04-crio-socket\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.936931 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.936924    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:06.436908745 +0000 UTC m=+49.987096606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:05.937172 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:05.936967    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:06.436951127 +0000 UTC m=+49.987138966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:05.937172 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.937084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c029a75a-d221-4913-9758-e5cffc9a3e04-data-volume\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.937172 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.937088    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c029a75a-d221-4913-9758-e5cffc9a3e04-crio-socket\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:05.945515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:05.945490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6snh\" (UniqueName: \"kubernetes.io/projected/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-api-access-f6snh\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:06.441454 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:06.441402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:06.441870 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:06.441515    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:06.441870 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:06.441536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:06.441870 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:06.441582    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:07.441567509 +0000 UTC m=+50.991755340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:06.441870 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:06.441647    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:06.441870 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:06.441707    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:07.441692933 +0000 UTC m=+50.991880767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:07.121803 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:07.121760    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x" event={"ID":"2d471cb1-4993-4cce-904c-c99b021b6975","Type":"ContainerStarted","Data":"f3b0aa423bc952ab78f826ece3dca4b4fb6d322a6d0d7c5ef9375c34f4b3daa3"}
Sep 11 16:03:07.146693 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:07.146640    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x" podStartSLOduration=2.044554058 podStartE2EDuration="6.146621483s" totalImagesPullingTime="4.102067425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:07.146462602 +0000 UTC m=+50.696650456" watchObservedRunningTime="2026-09-11 16:03:07.146621483 +0000 UTC m=+50.696809335"
Sep 11 16:03:07.449973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:07.449885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:07.449973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:07.449930    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:07.450389 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:07.450020    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:07.450389 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:07.450120    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.450096374 +0000 UTC m=+53.000284206 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:07.450389 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:07.450033    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:07.450389 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:07.450173    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:09.450159347 +0000 UTC m=+53.000347179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:07.569335 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:07.569304    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-npr6z_c5cf08d1-4023-4d0f-b38d-35ba5889a90f/dns-node-resolver/0.log"
Sep 11 16:03:08.566142 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:08.566115    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6zfb_70ef2110-78b6-4ecd-b9be-199eb5bee58b/node-ca/0.log"
Sep 11 16:03:09.068811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.068777    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:09.068964 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.068913    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:09.069005 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.068975    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls podName:e339260b-512e-48e1-a994-d1d01ccc80e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:17.068960913 +0000 UTC m=+60.619148745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5c8l7" (UID: "e339260b-512e-48e1-a994-d1d01ccc80e0") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:09.169742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.169707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:09.169887 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.169815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:09.169887 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.169858    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:03:09.169960 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.169889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:09.169960 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.169918    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:17.169901434 +0000 UTC m=+60.720089285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : secret "router-metrics-certs-default" not found
Sep 11 16:03:09.170114 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.169956    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 16:03:09.170114 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.169982    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:17.169971622 +0000 UTC m=+60.720159458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : configmap references non-existent config key: service-ca.crt
Sep 11 16:03:09.170114 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.170009    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls podName:65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a nodeName:}" failed. No retries permitted until 2026-09-11 16:03:17.169996361 +0000 UTC m=+60.720184192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-wgtl8" (UID: "65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a") : secret "samples-operator-tls" not found
Sep 11 16:03:09.270660 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.270623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:09.270802 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.270782    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:03:09.270843 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.270803    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fc4b44c-znwsd: secret "image-registry-tls" not found
Sep 11 16:03:09.270872 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.270860    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls podName:af783023-2976-4b5e-941b-e969e9dec533 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:17.270845829 +0000 UTC m=+60.821033661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls") pod "image-registry-8fc4b44c-znwsd" (UID: "af783023-2976-4b5e-941b-e969e9dec533") : secret "image-registry-tls" not found
Sep 11 16:03:09.361441 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.361367    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpqst_1d74b7d8-e76a-4b61-8059-3f210cbc9087/serve-healthcheck-canary/0.log"
Sep 11 16:03:09.472336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.472298    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:09.472336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:09.472336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:09.472535 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.472423    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:09.472535 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.472465    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:09.472535 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.472488    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:13.472471956 +0000 UTC m=+57.022659788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:09.472535 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:09.472512    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:13.472502331 +0000 UTC m=+57.022690162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:13.505521 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:13.505488    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:13.505989 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:13.505531    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:13.505989 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:13.505601    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:03:13.505989 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:13.505660    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:21.505646573 +0000 UTC m=+65.055834404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : configmap "kube-rbac-proxy" not found
Sep 11 16:03:13.505989 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:13.505679    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:13.505989 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:13.505731    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:21.505715477 +0000 UTC m=+65.055903311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:15.050981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:15.050951    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d9gbr"
Sep 11 16:03:17.135725 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.135671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:17.136325 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:17.135936    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:17.136325 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:17.136015    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls podName:e339260b-512e-48e1-a994-d1d01ccc80e0 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:33.135987806 +0000 UTC m=+76.686175637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-5c8l7" (UID: "e339260b-512e-48e1-a994-d1d01ccc80e0") : secret "cluster-monitoring-operator-tls" not found
Sep 11 16:03:17.236730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.236686    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:17.236730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.236727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:17.236933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.236808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:17.236933 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:17.236885    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:33.236865855 +0000 UTC m=+76.787053699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : configmap references non-existent config key: service-ca.crt
Sep 11 16:03:17.236933 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:17.236922    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 16:03:17.237032 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:17.237001    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs podName:e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:33.23698312 +0000 UTC m=+76.787170952 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs") pod "router-default-769b995cc4-mf8xv" (UID: "e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709") : secret "router-metrics-certs-default" not found
Sep 11 16:03:17.239249 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.239221    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-wgtl8\" (UID: \"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:17.263258 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.263232    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vh2tm\""
Sep 11 16:03:17.271476 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.271449    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"
Sep 11 16:03:17.337526 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.337498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:17.339780 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.339727    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"image-registry-8fc4b44c-znwsd\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") " pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:17.382205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.382184    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4k2h9\""
Sep 11 16:03:17.390243 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.390203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:17.539144 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.539108    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8"]
Sep 11 16:03:17.685588 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:17.685563    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8fc4b44c-znwsd"]
Sep 11 16:03:17.687005 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:17.686969    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf783023_2976_4b5e_941b_e969e9dec533.slice/crio-7c7ce85bee760c1f30d7a74776f1922a224fc0fe38762b9e10e6de33bb29ce92 WatchSource:0}: Error finding container 7c7ce85bee760c1f30d7a74776f1922a224fc0fe38762b9e10e6de33bb29ce92: Status 404 returned error can't find the container with id 7c7ce85bee760c1f30d7a74776f1922a224fc0fe38762b9e10e6de33bb29ce92
Sep 11 16:03:18.151701 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:18.151668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" event={"ID":"af783023-2976-4b5e-941b-e969e9dec533","Type":"ContainerStarted","Data":"66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e"}
Sep 11 16:03:18.152159 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:18.151719    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" event={"ID":"af783023-2976-4b5e-941b-e969e9dec533","Type":"ContainerStarted","Data":"7c7ce85bee760c1f30d7a74776f1922a224fc0fe38762b9e10e6de33bb29ce92"}
Sep 11 16:03:18.152159 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:18.151746    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:18.152908 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:18.152889    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8" event={"ID":"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a","Type":"ContainerStarted","Data":"0570c5eb0b0764e1d26d360c4e61b65b32ddaed30cb7a2f4bf989ce269217f04"}
Sep 11 16:03:18.174806 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:18.174759    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" podStartSLOduration=17.17474479 podStartE2EDuration="17.17474479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:18.173829225 +0000 UTC m=+61.724017078" watchObservedRunningTime="2026-09-11 16:03:18.17474479 +0000 UTC m=+61.724932658"
Sep 11 16:03:20.160705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:20.160667    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:03:20.163708 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:20.163645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efcfec48-1d15-49cd-bb60-b691f8cfa9b3-metrics-tls\") pod \"dns-default-g4v2m\" (UID: \"efcfec48-1d15-49cd-bb60-b691f8cfa9b3\") " pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:03:20.428289 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:20.428206    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lgnfp\""
Sep 11 16:03:20.435805 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:20.435773    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:03:20.920265 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:20.920235    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-g4v2m"]
Sep 11 16:03:20.923328 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:20.923302    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcfec48_1d15_49cd_bb60_b691f8cfa9b3.slice/crio-65c9588722f482fe16e5a529b4e001ae97b553bc218616daabeb71abcbf87422 WatchSource:0}: Error finding container 65c9588722f482fe16e5a529b4e001ae97b553bc218616daabeb71abcbf87422: Status 404 returned error can't find the container with id 65c9588722f482fe16e5a529b4e001ae97b553bc218616daabeb71abcbf87422
Sep 11 16:03:21.166152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.166113    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8" event={"ID":"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a","Type":"ContainerStarted","Data":"6c38dc7e4a7cf6b56b0a1b41ff4dd2c27961bd7447aa526cfba731247eca406f"}
Sep 11 16:03:21.166579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.166179    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8" event={"ID":"65c6d7ce-7aa4-4144-98fd-de3ff4eddb4a","Type":"ContainerStarted","Data":"8f8803a99a7c95d9dbe3341ea2a49267e5c75757d00e7469a3fddec6fb95a6fb"}
Sep 11 16:03:21.167384 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.167356    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4v2m" event={"ID":"efcfec48-1d15-49cd-bb60-b691f8cfa9b3","Type":"ContainerStarted","Data":"65c9588722f482fe16e5a529b4e001ae97b553bc218616daabeb71abcbf87422"}
Sep 11 16:03:21.188627 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.188583    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-wgtl8" podStartSLOduration=17.127560296 podStartE2EDuration="20.188568927s" totalImagesPullingTime="3.061008631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:21.187163126 +0000 UTC m=+64.737350980" watchObservedRunningTime="2026-09-11 16:03:21.188568927 +0000 UTC m=+64.738756791"
Sep 11 16:03:21.576122 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.576077    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:21.576122 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.576128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:21.576391 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:21.576287    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:21.576391 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:21.576374    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls podName:c029a75a-d221-4913-9758-e5cffc9a3e04 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:37.576351907 +0000 UTC m=+81.126539740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s9pmn" (UID: "c029a75a-d221-4913-9758-e5cffc9a3e04") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:03:21.576688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:21.576667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c029a75a-d221-4913-9758-e5cffc9a3e04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:22.686397 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:22.686359    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:03:22.688631 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:22.688603    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4-metrics-certs\") pod \"network-metrics-daemon-b2ggg\" (UID: \"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4\") " pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:03:22.801465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:22.801439    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tt876\""
Sep 11 16:03:22.809342 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:22.809324    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b2ggg"
Sep 11 16:03:23.086299 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:23.086269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b2ggg"]
Sep 11 16:03:23.088498 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:23.088472    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef363dd_5a76_4d8f_a1a8_fb01898ca0a4.slice/crio-f17db7556df2f495c565efe263dffc5498d6d55b9fef6524d4766fb5c92daa8f WatchSource:0}: Error finding container f17db7556df2f495c565efe263dffc5498d6d55b9fef6524d4766fb5c92daa8f: Status 404 returned error can't find the container with id f17db7556df2f495c565efe263dffc5498d6d55b9fef6524d4766fb5c92daa8f
Sep 11 16:03:23.175643 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:23.175607    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2ggg" event={"ID":"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4","Type":"ContainerStarted","Data":"f17db7556df2f495c565efe263dffc5498d6d55b9fef6524d4766fb5c92daa8f"}
Sep 11 16:03:23.177436 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:23.177408    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4v2m" event={"ID":"efcfec48-1d15-49cd-bb60-b691f8cfa9b3","Type":"ContainerStarted","Data":"7e4bd2a40a7f5523a7afe3d478ab14d41c77347478686cc17238014be3a16ab5"}
Sep 11 16:03:23.177582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:23.177451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-g4v2m" event={"ID":"efcfec48-1d15-49cd-bb60-b691f8cfa9b3","Type":"ContainerStarted","Data":"137eeb25f5c0a4f9eef7bc6c942330644529a9a9c6d1002752ae6b829f27a0df"}
Sep 11 16:03:23.177582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:23.177551    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:03:23.200967 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:23.200924    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-g4v2m" podStartSLOduration=33.685213684 podStartE2EDuration="35.200907847s" totalImagesPullingTime="1.515694163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:23.199684077 +0000 UTC m=+66.749871929" watchObservedRunningTime="2026-09-11 16:03:23.200907847 +0000 UTC m=+66.751095702"
Sep 11 16:03:27.196744 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:27.196713    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2ggg" event={"ID":"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4","Type":"ContainerStarted","Data":"3d95afb050ac666f637f9309569fd4f10325bd3848ce19192a609c0544b5a95c"}
Sep 11 16:03:27.197135 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:27.196766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b2ggg" event={"ID":"3ef363dd-5a76-4d8f-a1a8-fb01898ca0a4","Type":"ContainerStarted","Data":"5512092a18162d5d03d66af4e936f5f825b4ab351356855727e8bd67c15da927"}
Sep 11 16:03:27.220609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:27.220565    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b2ggg" podStartSLOduration=66.417728453 podStartE2EDuration="1m10.220550361s" totalImagesPullingTime="3.802821908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:27.218806085 +0000 UTC m=+70.768993939" watchObservedRunningTime="2026-09-11 16:03:27.220550361 +0000 UTC m=+70.770738213"
Sep 11 16:03:28.099513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:28.099485    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hmg8r"
Sep 11 16:03:32.864356 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.864320    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8fc4b44c-znwsd"]
Sep 11 16:03:32.868452 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.868417    2557 patch_prober.go:28] interesting pod/image-registry-8fc4b44c-znwsd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 16:03:32.868582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.868475    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" podUID="af783023-2976-4b5e-941b-e969e9dec533" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:03:32.916154 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.916124    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"]
Sep 11 16:03:32.918247 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.918231    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:32.920812 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.920789    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mlhws\""
Sep 11 16:03:32.921708 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.921691    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 16:03:32.922206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.922192    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 16:03:32.926222 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.926190    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-pcn48"]
Sep 11 16:03:32.928700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.928681    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:32.934107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.933850    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 16:03:32.934107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.933942    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zkbz7\""
Sep 11 16:03:32.934107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.934029    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 16:03:32.946538 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.946515    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"]
Sep 11 16:03:32.947758 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:32.947740    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-pcn48"]
Sep 11 16:03:33.027308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.026225    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b995bb69-62jpz"]
Sep 11 16:03:33.028486 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.028469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.062328 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.062302    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3b901584-7eea-45e7-8a42-3dc8d3d18210-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rmnc6\" (UID: \"3b901584-7eea-45e7-8a42-3dc8d3d18210\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.062464 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.062337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3b901584-7eea-45e7-8a42-3dc8d3d18210-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rmnc6\" (UID: \"3b901584-7eea-45e7-8a42-3dc8d3d18210\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.062464 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.062375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t98sg\" (UniqueName: \"kubernetes.io/projected/f4a24858-2fd5-45d7-a9f2-e2ff782acbca-kube-api-access-t98sg\") pod \"downloads-76f99584f4-pcn48\" (UID: \"f4a24858-2fd5-45d7-a9f2-e2ff782acbca\") " pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:33.064540 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.064518    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b995bb69-62jpz"]
Sep 11 16:03:33.163268 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b862348e-fb95-4442-ba3d-f421890b0edc-image-registry-private-configuration\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163268 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163219    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b862348e-fb95-4442-ba3d-f421890b0edc-installation-pull-secrets\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163268 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-registry-tls\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163268 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3b901584-7eea-45e7-8a42-3dc8d3d18210-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rmnc6\" (UID: \"3b901584-7eea-45e7-8a42-3dc8d3d18210\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.163491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-bound-sa-token\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163356    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3b901584-7eea-45e7-8a42-3dc8d3d18210-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rmnc6\" (UID: \"3b901584-7eea-45e7-8a42-3dc8d3d18210\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.163491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t98sg\" (UniqueName: \"kubernetes.io/projected/f4a24858-2fd5-45d7-a9f2-e2ff782acbca-kube-api-access-t98sg\") pod \"downloads-76f99584f4-pcn48\" (UID: \"f4a24858-2fd5-45d7-a9f2-e2ff782acbca\") " pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:33.163491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163420    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b862348e-fb95-4442-ba3d-f421890b0edc-trusted-ca\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163451    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b862348e-fb95-4442-ba3d-f421890b0edc-ca-trust-extracted\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163540    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b862348e-fb95-4442-ba3d-f421890b0edc-registry-certificates\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.163666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:33.163666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.163611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4swg6\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-kube-api-access-4swg6\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.167961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.164419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3b901584-7eea-45e7-8a42-3dc8d3d18210-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-rmnc6\" (UID: \"3b901584-7eea-45e7-8a42-3dc8d3d18210\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.167961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.166450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3b901584-7eea-45e7-8a42-3dc8d3d18210-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-rmnc6\" (UID: \"3b901584-7eea-45e7-8a42-3dc8d3d18210\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.168931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.168907    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e339260b-512e-48e1-a994-d1d01ccc80e0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-5c8l7\" (UID: \"e339260b-512e-48e1-a994-d1d01ccc80e0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:33.182307 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.182288    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-g4v2m"
Sep 11 16:03:33.193255 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.193235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t98sg\" (UniqueName: \"kubernetes.io/projected/f4a24858-2fd5-45d7-a9f2-e2ff782acbca-kube-api-access-t98sg\") pod \"downloads-76f99584f4-pcn48\" (UID: \"f4a24858-2fd5-45d7-a9f2-e2ff782acbca\") " pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:33.228322 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.228295    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"
Sep 11 16:03:33.236686 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.236529    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:33.264720 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.264684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-bound-sa-token\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.264878 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.264767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b862348e-fb95-4442-ba3d-f421890b0edc-trusted-ca\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.264878 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.264797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b862348e-fb95-4442-ba3d-f421890b0edc-ca-trust-extracted\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.264987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.264885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:33.264987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.264940    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:33.265106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.264990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b862348e-fb95-4442-ba3d-f421890b0edc-registry-certificates\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.265106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.265057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4swg6\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-kube-api-access-4swg6\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.265206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.265130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b862348e-fb95-4442-ba3d-f421890b0edc-image-registry-private-configuration\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.265206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.265160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b862348e-fb95-4442-ba3d-f421890b0edc-installation-pull-secrets\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.265206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.265199    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-registry-tls\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.265584 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.265562    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b862348e-fb95-4442-ba3d-f421890b0edc-ca-trust-extracted\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.266079 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.265986    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b862348e-fb95-4442-ba3d-f421890b0edc-trusted-ca\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.266234 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.266202    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-service-ca-bundle\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:33.266382 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.266350    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b862348e-fb95-4442-ba3d-f421890b0edc-registry-certificates\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.268239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.268212    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709-metrics-certs\") pod \"router-default-769b995cc4-mf8xv\" (UID: \"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709\") " pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:33.268731 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.268682    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b862348e-fb95-4442-ba3d-f421890b0edc-image-registry-private-configuration\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.268891 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.268859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b862348e-fb95-4442-ba3d-f421890b0edc-installation-pull-secrets\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.269627 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.269589    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-registry-tls\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.274546 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.274506    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-bound-sa-token\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.275100 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.275080    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4swg6\" (UniqueName: \"kubernetes.io/projected/b862348e-fb95-4442-ba3d-f421890b0edc-kube-api-access-4swg6\") pod \"image-registry-77b995bb69-62jpz\" (UID: \"b862348e-fb95-4442-ba3d-f421890b0edc\") " pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.339868 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.339841    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:33.366576 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.366550    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n657h\""
Sep 11 16:03:33.374662 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.374634    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"
Sep 11 16:03:33.501888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.501866    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jsw8x\""
Sep 11 16:03:33.507433 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.507409    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6"]
Sep 11 16:03:33.508172 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.508158    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:33.510501 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:33.510411    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b901584_7eea_45e7_8a42_3dc8d3d18210.slice/crio-ac2a83236ad8d3ab67f7c241429f018bc00b54f705386bc9e949a6271c6ea152 WatchSource:0}: Error finding container ac2a83236ad8d3ab67f7c241429f018bc00b54f705386bc9e949a6271c6ea152: Status 404 returned error can't find the container with id ac2a83236ad8d3ab67f7c241429f018bc00b54f705386bc9e949a6271c6ea152
Sep 11 16:03:33.516594 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.516546    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-pcn48"]
Sep 11 16:03:33.518435 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:33.518413    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a24858_2fd5_45d7_a9f2_e2ff782acbca.slice/crio-ca066899454b60d10ce292ddda6b0ca6f0826f03dd459dfa90892381b0dff238 WatchSource:0}: Error finding container ca066899454b60d10ce292ddda6b0ca6f0826f03dd459dfa90892381b0dff238: Status 404 returned error can't find the container with id ca066899454b60d10ce292ddda6b0ca6f0826f03dd459dfa90892381b0dff238
Sep 11 16:03:33.609961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.609933    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b995bb69-62jpz"]
Sep 11 16:03:33.612643 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:33.612622    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb862348e_fb95_4442_ba3d_f421890b0edc.slice/crio-65f80d91f94f1ff6256c199de20e994b8074506c81ec4d637d8b57cb543c6ccc WatchSource:0}: Error finding container 65f80d91f94f1ff6256c199de20e994b8074506c81ec4d637d8b57cb543c6ccc: Status 404 returned error can't find the container with id 65f80d91f94f1ff6256c199de20e994b8074506c81ec4d637d8b57cb543c6ccc
Sep 11 16:03:33.651884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.651774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7"]
Sep 11 16:03:33.654184 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:33.654155    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode339260b_512e_48e1_a994_d1d01ccc80e0.slice/crio-116d3df8f28b7a22edf2043337560a879feed7647ac15daf0e4d724b2c5006c8 WatchSource:0}: Error finding container 116d3df8f28b7a22edf2043337560a879feed7647ac15daf0e4d724b2c5006c8: Status 404 returned error can't find the container with id 116d3df8f28b7a22edf2043337560a879feed7647ac15daf0e4d724b2c5006c8
Sep 11 16:03:33.779352 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:33.779169    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-769b995cc4-mf8xv"]
Sep 11 16:03:33.782513 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:33.782484    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e34c2b_f6a4_4287_aa8a_f7caa9bb7709.slice/crio-636b41d4c6ef44086d90a3b623100ffa1514edff90674f2afce2b0321ab1ae2f WatchSource:0}: Error finding container 636b41d4c6ef44086d90a3b623100ffa1514edff90674f2afce2b0321ab1ae2f: Status 404 returned error can't find the container with id 636b41d4c6ef44086d90a3b623100ffa1514edff90674f2afce2b0321ab1ae2f
Sep 11 16:03:34.220890 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.220579    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-769b995cc4-mf8xv" event={"ID":"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709","Type":"ContainerStarted","Data":"b084ef16c0b96bb32a712555f1bbaacf8b0d62d364385eebea7b451c478165b1"}
Sep 11 16:03:34.220890 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.220668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-769b995cc4-mf8xv" event={"ID":"e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709","Type":"ContainerStarted","Data":"636b41d4c6ef44086d90a3b623100ffa1514edff90674f2afce2b0321ab1ae2f"}
Sep 11 16:03:34.222858 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.222819    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7" event={"ID":"e339260b-512e-48e1-a994-d1d01ccc80e0","Type":"ContainerStarted","Data":"116d3df8f28b7a22edf2043337560a879feed7647ac15daf0e4d724b2c5006c8"}
Sep 11 16:03:34.224714 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.224662    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-pcn48" event={"ID":"f4a24858-2fd5-45d7-a9f2-e2ff782acbca","Type":"ContainerStarted","Data":"ca066899454b60d10ce292ddda6b0ca6f0826f03dd459dfa90892381b0dff238"}
Sep 11 16:03:34.228148 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.227488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b995bb69-62jpz" event={"ID":"b862348e-fb95-4442-ba3d-f421890b0edc","Type":"ContainerStarted","Data":"6e9d5b2fdb1cee97dea0dfb5e797dea4046fea40a00340183557e3c7fb13922d"}
Sep 11 16:03:34.228148 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.227536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b995bb69-62jpz" event={"ID":"b862348e-fb95-4442-ba3d-f421890b0edc","Type":"ContainerStarted","Data":"65f80d91f94f1ff6256c199de20e994b8074506c81ec4d637d8b57cb543c6ccc"}
Sep 11 16:03:34.228148 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.228085    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:34.229860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.229812    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6" event={"ID":"3b901584-7eea-45e7-8a42-3dc8d3d18210","Type":"ContainerStarted","Data":"ac2a83236ad8d3ab67f7c241429f018bc00b54f705386bc9e949a6271c6ea152"}
Sep 11 16:03:34.240036 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.239977    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-769b995cc4-mf8xv" podStartSLOduration=33.239959685 podStartE2EDuration="33.239959685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:34.23893038 +0000 UTC m=+77.789118233" watchObservedRunningTime="2026-09-11 16:03:34.239959685 +0000 UTC m=+77.790147529"
Sep 11 16:03:34.261721 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.261443    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b995bb69-62jpz" podStartSLOduration=2.26142637 podStartE2EDuration="2.26142637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:34.259162368 +0000 UTC m=+77.809350234" watchObservedRunningTime="2026-09-11 16:03:34.26142637 +0000 UTC m=+77.811614219"
Sep 11 16:03:34.509238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.509170    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:34.514531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:34.514293    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:35.235730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:35.235666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6" event={"ID":"3b901584-7eea-45e7-8a42-3dc8d3d18210","Type":"ContainerStarted","Data":"3e0ca10b58376a69eba12a1ebae61773b7cf6d1be7e6373272fc8218493a95da"}
Sep 11 16:03:35.236571 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:35.236418    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:35.237807 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:35.237787    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-769b995cc4-mf8xv"
Sep 11 16:03:35.255183 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:35.255128    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-rmnc6" podStartSLOduration=2.018059151 podStartE2EDuration="3.255107701s" totalImagesPullingTime="1.23704855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:35.253187442 +0000 UTC m=+78.803375312" watchObservedRunningTime="2026-09-11 16:03:35.255107701 +0000 UTC m=+78.805295556"
Sep 11 16:03:36.241406 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:36.241276    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7" event={"ID":"e339260b-512e-48e1-a994-d1d01ccc80e0","Type":"ContainerStarted","Data":"5dbd299e4f2d4a082fdd200ebf62aa4cbdd94e250bc4a160ff9907a19c26b008"}
Sep 11 16:03:36.259119 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:36.259065    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-5c8l7" podStartSLOduration=33.345504509 podStartE2EDuration="35.25902974s" totalImagesPullingTime="1.913525231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:36.258962816 +0000 UTC m=+79.809150669" watchObservedRunningTime="2026-09-11 16:03:36.25902974 +0000 UTC m=+79.809217595"
Sep 11 16:03:37.605518 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:37.605479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:37.608221 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:37.608192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c029a75a-d221-4913-9758-e5cffc9a3e04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s9pmn\" (UID: \"c029a75a-d221-4913-9758-e5cffc9a3e04\") " pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:37.765064 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:37.765012    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-krpkn\""
Sep 11 16:03:37.773377 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:37.773354    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s9pmn"
Sep 11 16:03:38.070213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:38.070132    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s9pmn"]
Sep 11 16:03:38.074073 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:38.074034    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc029a75a_d221_4913_9758_e5cffc9a3e04.slice/crio-e5e66ceadf8b5d5f4f15584bdcc622b7b29218a03c3c40618e72084e7c969c67 WatchSource:0}: Error finding container e5e66ceadf8b5d5f4f15584bdcc622b7b29218a03c3c40618e72084e7c969c67: Status 404 returned error can't find the container with id e5e66ceadf8b5d5f4f15584bdcc622b7b29218a03c3c40618e72084e7c969c67
Sep 11 16:03:38.250092 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:38.250056    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9pmn" event={"ID":"c029a75a-d221-4913-9758-e5cffc9a3e04","Type":"ContainerStarted","Data":"1e15224b5d0d28282c7f8e8055332e412dc267954841afafa63814f038c0a47f"}
Sep 11 16:03:38.250229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:38.250119    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9pmn" event={"ID":"c029a75a-d221-4913-9758-e5cffc9a3e04","Type":"ContainerStarted","Data":"e5e66ceadf8b5d5f4f15584bdcc622b7b29218a03c3c40618e72084e7c969c67"}
Sep 11 16:03:39.256638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:39.256557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9pmn" event={"ID":"c029a75a-d221-4913-9758-e5cffc9a3e04","Type":"ContainerStarted","Data":"ac3bc7a987e2480195c0bec8eaf8bd0d795ba2327f326e8dcd733f631091e3b9"}
Sep 11 16:03:41.267388 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:41.267348    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s9pmn" event={"ID":"c029a75a-d221-4913-9758-e5cffc9a3e04","Type":"ContainerStarted","Data":"279a659b03bc1dc5db7694464a7cf4b25edd5c072df8b621dbceec4a9fe6b1e6"}
Sep 11 16:03:41.295912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:41.295842    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s9pmn" podStartSLOduration=34.223393906 podStartE2EDuration="36.295820882s" totalImagesPullingTime="2.072426976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:03:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:41.294068631 +0000 UTC m=+84.844256482" watchObservedRunningTime="2026-09-11 16:03:41.295820882 +0000 UTC m=+84.846008737"
Sep 11 16:03:42.870117 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:42.870036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:47.563830 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.563801    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"]
Sep 11 16:03:47.568626 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.568602    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.576710 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.576688    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 16:03:47.577845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.577821    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 16:03:47.579032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.579017    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 16:03:47.580125 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.580104    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hcrt8\""
Sep 11 16:03:47.615845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.615812    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g4sln"]
Sep 11 16:03:47.619133 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.619111    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.623933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.623860    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 16:03:47.623933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.623879    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2mr97\""
Sep 11 16:03:47.624298 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.624278    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 16:03:47.624370 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.624301    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 16:03:47.653110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.653076    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"]
Sep 11 16:03:47.687436 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.687388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1f1026-c883-4f16-b86c-f82e7f299336-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.687618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.687438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be1f1026-c883-4f16-b86c-f82e7f299336-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.687618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.687472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlh6h\" (UniqueName: \"kubernetes.io/projected/be1f1026-c883-4f16-b86c-f82e7f299336-kube-api-access-dlh6h\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.687618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.687594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be1f1026-c883-4f16-b86c-f82e7f299336-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.788814 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.788773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.788978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.788833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-wtmp\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.788978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.788863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.788978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.788912    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1f1026-c883-4f16-b86c-f82e7f299336-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.788978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.788930    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvb46\" (UniqueName: \"kubernetes.io/projected/1b99a22e-4f78-4757-a951-2576cdba42f7-kube-api-access-xvb46\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.789194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.788983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be1f1026-c883-4f16-b86c-f82e7f299336-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.789194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789026    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-tls\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.789194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789078    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-sys\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.789194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789140    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlh6h\" (UniqueName: \"kubernetes.io/projected/be1f1026-c883-4f16-b86c-f82e7f299336-kube-api-access-dlh6h\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.789194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789183    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-root\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.789402 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789215    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-textfile\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.789402 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b99a22e-4f78-4757-a951-2576cdba42f7-metrics-client-ca\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.789402 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be1f1026-c883-4f16-b86c-f82e7f299336-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.789904 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.789878    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be1f1026-c883-4f16-b86c-f82e7f299336-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.791565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.791542    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/be1f1026-c883-4f16-b86c-f82e7f299336-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.791843 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.791823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be1f1026-c883-4f16-b86c-f82e7f299336-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.804609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.804583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlh6h\" (UniqueName: \"kubernetes.io/projected/be1f1026-c883-4f16-b86c-f82e7f299336-kube-api-access-dlh6h\") pod \"openshift-state-metrics-67dcf8c979-tpq85\" (UID: \"be1f1026-c883-4f16-b86c-f82e7f299336\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.879547 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.879477    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"
Sep 11 16:03:47.890716 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-wtmp\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.890856 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890726    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.890856 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvb46\" (UniqueName: \"kubernetes.io/projected/1b99a22e-4f78-4757-a951-2576cdba42f7-kube-api-access-xvb46\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.890856 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-tls\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.890856 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-sys\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.890856 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890856    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-root\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891126 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890884    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-textfile\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891126 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890891    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-wtmp\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891126 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.890905    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b99a22e-4f78-4757-a951-2576cdba42f7-metrics-client-ca\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891126 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.891000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.891152    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-sys\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.891232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b99a22e-4f78-4757-a951-2576cdba42f7-root\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891302 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:47.891245    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 16:03:47.891409 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:47.891310    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-tls podName:1b99a22e-4f78-4757-a951-2576cdba42f7 nodeName:}" failed. No retries permitted until 2026-09-11 16:03:48.39129094 +0000 UTC m=+91.941478781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-tls") pod "node-exporter-g4sln" (UID: "1b99a22e-4f78-4757-a951-2576cdba42f7") : secret "node-exporter-tls" not found
Sep 11 16:03:47.891499 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.891476    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b99a22e-4f78-4757-a951-2576cdba42f7-metrics-client-ca\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891607 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.891551    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-textfile\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.891607 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.891586    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.893283 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.893263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:47.908344 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:47.908311    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvb46\" (UniqueName: \"kubernetes.io/projected/1b99a22e-4f78-4757-a951-2576cdba42f7-kube-api-access-xvb46\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:48.396208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:48.396170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-tls\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:48.398534 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:48.398512    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b99a22e-4f78-4757-a951-2576cdba42f7-node-exporter-tls\") pod \"node-exporter-g4sln\" (UID: \"1b99a22e-4f78-4757-a951-2576cdba42f7\") " pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:48.529486 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:48.529452    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g4sln"
Sep 11 16:03:49.717022 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:49.716986    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b99a22e_4f78_4757_a951_2576cdba42f7.slice/crio-a5241834a483ceaaa9110f9e6cae11a00952b2016cc3ad2ae830ab0ac138a17e WatchSource:0}: Error finding container a5241834a483ceaaa9110f9e6cae11a00952b2016cc3ad2ae830ab0ac138a17e: Status 404 returned error can't find the container with id a5241834a483ceaaa9110f9e6cae11a00952b2016cc3ad2ae830ab0ac138a17e
Sep 11 16:03:49.985106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:49.985059    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85"]
Sep 11 16:03:49.987538 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:49.987501    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1f1026_c883_4f16_b86c_f82e7f299336.slice/crio-aa6335a8d1c16daaf3cd01ccd9ff052fd7fcb79bc143f530d525653cebdcb048 WatchSource:0}: Error finding container aa6335a8d1c16daaf3cd01ccd9ff052fd7fcb79bc143f530d525653cebdcb048: Status 404 returned error can't find the container with id aa6335a8d1c16daaf3cd01ccd9ff052fd7fcb79bc143f530d525653cebdcb048
Sep 11 16:03:50.304186 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.304144    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-pcn48" event={"ID":"f4a24858-2fd5-45d7-a9f2-e2ff782acbca","Type":"ContainerStarted","Data":"40d6af1d660a982f92ef04e6a249d94986b27497ad5111a818d0e9b9519e9c20"}
Sep 11 16:03:50.304662 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.304640    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:50.307727 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.307700    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85" event={"ID":"be1f1026-c883-4f16-b86c-f82e7f299336","Type":"ContainerStarted","Data":"df6f6f5238daf4e907a91e7b2b840f61092774d58f03a6403adc76d96831c64c"}
Sep 11 16:03:50.307841 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.307756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85" event={"ID":"be1f1026-c883-4f16-b86c-f82e7f299336","Type":"ContainerStarted","Data":"fc19ea9bd2c53b09dafa9a819fe96d93acfcaaea88880b606d891b2cf7df21a4"}
Sep 11 16:03:50.307841 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.307791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85" event={"ID":"be1f1026-c883-4f16-b86c-f82e7f299336","Type":"ContainerStarted","Data":"aa6335a8d1c16daaf3cd01ccd9ff052fd7fcb79bc143f530d525653cebdcb048"}
Sep 11 16:03:50.309380 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.309356    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4sln" event={"ID":"1b99a22e-4f78-4757-a951-2576cdba42f7","Type":"ContainerStarted","Data":"a5241834a483ceaaa9110f9e6cae11a00952b2016cc3ad2ae830ab0ac138a17e"}
Sep 11 16:03:50.316149 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.316118    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-pcn48"
Sep 11 16:03:50.324297 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.324245    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-pcn48" podStartSLOduration=2.019174071 podStartE2EDuration="18.324226363s" totalImagesPullingTime="16.305052292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:50.322519909 +0000 UTC m=+93.872707763" watchObservedRunningTime="2026-09-11 16:03:50.324226363 +0000 UTC m=+93.874414217"
Sep 11 16:03:50.728288 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.728091    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7498889567-kj7pg"]
Sep 11 16:03:50.732360 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.732334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.735113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.735090    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 11 16:03:50.735614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.735592    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zsg24\""
Sep 11 16:03:50.735909 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.735887    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 11 16:03:50.736031 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.735966    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 11 16:03:50.736114 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.736064    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-i3utd86l3v40\""
Sep 11 16:03:50.736166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.736127    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 11 16:03:50.736218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.736198    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 11 16:03:50.746613 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.746591    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7498889567-kj7pg"]
Sep 11 16:03:50.918557 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918646    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-grpc-tls\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918676    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88698f1b-e5e1-44da-9511-350e5916b6b8-metrics-client-ca\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-tls\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:50.918888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:50.918828    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdxdh\" (UniqueName: \"kubernetes.io/projected/88698f1b-e5e1-44da-9511-350e5916b6b8-kube-api-access-pdxdh\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.020303 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020220    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88698f1b-e5e1-44da-9511-350e5916b6b8-metrics-client-ca\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.020303 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020273    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-tls\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdxdh\" (UniqueName: \"kubernetes.io/projected/88698f1b-e5e1-44da-9511-350e5916b6b8-kube-api-access-pdxdh\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020412    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020458    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-grpc-tls\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.020905    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.021415 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.021307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88698f1b-e5e1-44da-9511-350e5916b6b8-metrics-client-ca\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.024534 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.024489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.024762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.024732    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-grpc-tls\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.026018 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.025937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.026882 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.026856    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.027392 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.027369    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.031662 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.031617    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdxdh\" (UniqueName: \"kubernetes.io/projected/88698f1b-e5e1-44da-9511-350e5916b6b8-kube-api-access-pdxdh\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.032284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.032252    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/88698f1b-e5e1-44da-9511-350e5916b6b8-secret-thanos-querier-tls\") pod \"thanos-querier-7498889567-kj7pg\" (UID: \"88698f1b-e5e1-44da-9511-350e5916b6b8\") " pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.044614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.044436    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:51.318435 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.317095    2557 generic.go:356] "Generic (PLEG): container finished" podID="1b99a22e-4f78-4757-a951-2576cdba42f7" containerID="9e619f60e35ac50cfecc0a61df56ebef6e25899d2857ec41eb1d8f1a68716954" exitCode=0
Sep 11 16:03:51.318435 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.318149    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4sln" event={"ID":"1b99a22e-4f78-4757-a951-2576cdba42f7","Type":"ContainerDied","Data":"9e619f60e35ac50cfecc0a61df56ebef6e25899d2857ec41eb1d8f1a68716954"}
Sep 11 16:03:51.360562 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:51.360527    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7498889567-kj7pg"]
Sep 11 16:03:51.372090 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:51.372060    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88698f1b_e5e1_44da_9511_350e5916b6b8.slice/crio-242b745d0e5dd6409b55323041e8e5c8176aa4b52541c7a767b10b6e3e89214f WatchSource:0}: Error finding container 242b745d0e5dd6409b55323041e8e5c8176aa4b52541c7a767b10b6e3e89214f: Status 404 returned error can't find the container with id 242b745d0e5dd6409b55323041e8e5c8176aa4b52541c7a767b10b6e3e89214f
Sep 11 16:03:52.312726 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.312681    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"]
Sep 11 16:03:52.340328 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.340300    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"]
Sep 11 16:03:52.340513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.340342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85" event={"ID":"be1f1026-c883-4f16-b86c-f82e7f299336","Type":"ContainerStarted","Data":"d6bd6e4927480201b29ebcfa004f8c655c8c384c59f6e96552ceeb1aa02b6d7c"}
Sep 11 16:03:52.340513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.340388    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"242b745d0e5dd6409b55323041e8e5c8176aa4b52541c7a767b10b6e3e89214f"}
Sep 11 16:03:52.340513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.340409    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.340513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.340438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4sln" event={"ID":"1b99a22e-4f78-4757-a951-2576cdba42f7","Type":"ContainerStarted","Data":"793486ad99ec64793f726bf985b533f8580b3c944157be21f8182ce22549607f"}
Sep 11 16:03:52.340513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.340468    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g4sln" event={"ID":"1b99a22e-4f78-4757-a951-2576cdba42f7","Type":"ContainerStarted","Data":"a8e954c42c0840d7a0cabef86efaf3120580970869609c0ae8bea06eeeedee6c"}
Sep 11 16:03:52.343096 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.343066    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 16:03:52.343712 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.343688    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-nwvvw\""
Sep 11 16:03:52.348369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.348328    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-tpq85" podStartSLOduration=4.034592949 podStartE2EDuration="5.348309205s" totalImagesPullingTime="1.313716256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:52.347937238 +0000 UTC m=+95.898125092" watchObservedRunningTime="2026-09-11 16:03:52.348309205 +0000 UTC m=+95.898497058"
Sep 11 16:03:52.391535 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.391474    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g4sln" podStartSLOduration=4.292788585 podStartE2EDuration="5.391458232s" totalImagesPullingTime="1.010500752s" totalInitContainerRuntime="88.168895ms" isStatefulPod=true podCreationTimestamp="2026-09-11 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:52.39086831 +0000 UTC m=+95.941056177" watchObservedRunningTime="2026-09-11 16:03:52.391458232 +0000 UTC m=+95.941646085"
Sep 11 16:03:52.533606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.533563    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e9aafbd-4811-431f-a37f-0c4ccf8eb85b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xzpd2\" (UID: \"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.533606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.533613    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chql2\" (UniqueName: \"kubernetes.io/projected/2e9aafbd-4811-431f-a37f-0c4ccf8eb85b-kube-api-access-chql2\") pod \"monitoring-plugin-5d85778b9d-xzpd2\" (UID: \"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.635152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.635073    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e9aafbd-4811-431f-a37f-0c4ccf8eb85b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xzpd2\" (UID: \"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.635152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.635124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chql2\" (UniqueName: \"kubernetes.io/projected/2e9aafbd-4811-431f-a37f-0c4ccf8eb85b-kube-api-access-chql2\") pod \"monitoring-plugin-5d85778b9d-xzpd2\" (UID: \"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.637787 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.637754    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2e9aafbd-4811-431f-a37f-0c4ccf8eb85b-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-xzpd2\" (UID: \"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.652561 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.652535    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chql2\" (UniqueName: \"kubernetes.io/projected/2e9aafbd-4811-431f-a37f-0c4ccf8eb85b-kube-api-access-chql2\") pod \"monitoring-plugin-5d85778b9d-xzpd2\" (UID: \"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.652680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.652650    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:52.971487 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:52.971268    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"]
Sep 11 16:03:53.336135 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:53.336089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2" event={"ID":"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b","Type":"ContainerStarted","Data":"1606071d76a1d0cb93376d9e2133c9fcc500cc3434859e3dff0aa538614a163f"}
Sep 11 16:03:54.067462 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.067428    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:03:54.100393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.100279    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.111767 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.111739    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.112125    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.112365    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.112542    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.113808    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-62d7c\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.114006    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.114239    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.114304    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.114243    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.114496    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 11 16:03:54.114949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.114723    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 11 16:03:54.115498 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.115140    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 11 16:03:54.115498 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.115160    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 11 16:03:54.115498 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.115431    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 11 16:03:54.116391 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.116342    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-19ma8e3qfv94o\""
Sep 11 16:03:54.119089 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.117919    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 11 16:03:54.119619 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.119484    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 11 16:03:54.127583 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.127563    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:03:54.150886 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.150856    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-web-config\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151011 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.150905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151011 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.150937    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151011 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.150979    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151179 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151012    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psvbh\" (UniqueName: \"kubernetes.io/projected/26ff7bdb-6253-4196-be2c-7d7999a74daf-kube-api-access-psvbh\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151179 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151062    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26ff7bdb-6253-4196-be2c-7d7999a74daf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151179 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151300 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26ff7bdb-6253-4196-be2c-7d7999a74daf-config-out\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151300 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151300 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151300 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151253    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151300 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151406    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151462    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-config\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.151780 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.151535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252186 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252141    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psvbh\" (UniqueName: \"kubernetes.io/projected/26ff7bdb-6253-4196-be2c-7d7999a74daf-kube-api-access-psvbh\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252366 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26ff7bdb-6253-4196-be2c-7d7999a74daf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252366 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252366 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26ff7bdb-6253-4196-be2c-7d7999a74daf-config-out\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252366 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252366 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252399    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252426    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252500    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252571    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.252637 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-config\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-web-config\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.252817    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253301 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.253196    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253687 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.253457    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.253687 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.253580    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.254670 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.254626    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.255273 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.255247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.255874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.255852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.256866    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-config\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.257253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.257683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.258452    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/26ff7bdb-6253-4196-be2c-7d7999a74daf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.259093    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/26ff7bdb-6253-4196-be2c-7d7999a74daf-config-out\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.259142    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.259539    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.259935    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.260524    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-web-config\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.260939    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.262175    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/26ff7bdb-6253-4196-be2c-7d7999a74daf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.262212    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.262314    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/26ff7bdb-6253-4196-be2c-7d7999a74daf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.263063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.262966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psvbh\" (UniqueName: \"kubernetes.io/projected/26ff7bdb-6253-4196-be2c-7d7999a74daf-kube-api-access-psvbh\") pod \"prometheus-k8s-0\" (UID: \"26ff7bdb-6253-4196-be2c-7d7999a74daf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.417393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.417322    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:03:54.732605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:54.732572    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 11 16:03:54.734460 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:03:54.734428    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ff7bdb_6253_4196_be2c_7d7999a74daf.slice/crio-495caeeae619f83a6ebbfab9e81c5a1c1ecd938bbf89fbe3450d16737c3f9a48 WatchSource:0}: Error finding container 495caeeae619f83a6ebbfab9e81c5a1c1ecd938bbf89fbe3450d16737c3f9a48: Status 404 returned error can't find the container with id 495caeeae619f83a6ebbfab9e81c5a1c1ecd938bbf89fbe3450d16737c3f9a48
Sep 11 16:03:55.351833 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:55.351786    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"7bbbdee003f25401fbc2be7d5e0fafd53876438e4c21483a2bdc26a9c8e07765"}
Sep 11 16:03:55.352013 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:55.351916    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"6b97fde8ca0702aead17217e74fb648a9d168f13ee5a7d7e79fd29d914d2d31f"}
Sep 11 16:03:55.352013 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:55.351962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"63437ee1d4c90bbdc28f44fd598c9aba740dd001225edd99a4e47dd1a5f48fb7"}
Sep 11 16:03:55.353626 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:55.353540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"495caeeae619f83a6ebbfab9e81c5a1c1ecd938bbf89fbe3450d16737c3f9a48"}
Sep 11 16:03:56.247980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:56.247945    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77b995bb69-62jpz"
Sep 11 16:03:57.364967 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.364936    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2" event={"ID":"2e9aafbd-4811-431f-a37f-0c4ccf8eb85b","Type":"ContainerStarted","Data":"3d638abf9a0e3ccf391d8f1407517c75595a4829b829a589735bbb44487be0b3"}
Sep 11 16:03:57.366845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.366813    2557 generic.go:356] "Generic (PLEG): container finished" podID="26ff7bdb-6253-4196-be2c-7d7999a74daf" containerID="636f38ff9ddf3f02579e23ce46f17afe72088a5e99942f2e03214c8815c925cf" exitCode=0
Sep 11 16:03:57.366975 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.366849    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerDied","Data":"636f38ff9ddf3f02579e23ce46f17afe72088a5e99942f2e03214c8815c925cf"}
Sep 11 16:03:57.368992 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.368903    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:57.374677 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.374634    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2"
Sep 11 16:03:57.425993 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.425938    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-xzpd2" podStartSLOduration=1.523546986 podStartE2EDuration="5.425919573s" totalImagesPullingTime="3.902372587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:57.424847581 +0000 UTC m=+100.975035433" watchObservedRunningTime="2026-09-11 16:03:57.425919573 +0000 UTC m=+100.976107425"
Sep 11 16:03:57.883088 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:57.882971    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" podUID="af783023-2976-4b5e-941b-e969e9dec533" containerName="registry" containerID="cri-o://66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e" gracePeriod=30
Sep 11 16:03:58.187546 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.187479    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:58.293109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293072    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz9k6\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-kube-api-access-tz9k6\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293289 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293136    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-trusted-ca\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293289 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293158    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-bound-sa-token\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293289 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293203    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-registry-certificates\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293289 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293269    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af783023-2976-4b5e-941b-e969e9dec533-ca-trust-extracted\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293306    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-image-registry-private-configuration\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293343    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-installation-pull-secrets\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.293488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.293387    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") pod \"af783023-2976-4b5e-941b-e969e9dec533\" (UID: \"af783023-2976-4b5e-941b-e969e9dec533\") "
Sep 11 16:03:58.296137 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.296023    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-kube-api-access-tz9k6" (OuterVolumeSpecName: "kube-api-access-tz9k6") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "kube-api-access-tz9k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:03:58.296600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.296417    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:03:58.296600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.296467    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:03:58.296600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.296571    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:03:58.297325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.297108    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:03:58.297512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.297487    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:03:58.304532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.304495    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:03:58.306069 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.306014    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af783023-2976-4b5e-941b-e969e9dec533-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "af783023-2976-4b5e-941b-e969e9dec533" (UID: "af783023-2976-4b5e-941b-e969e9dec533"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:03:58.374323 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.374276    2557 generic.go:356] "Generic (PLEG): container finished" podID="af783023-2976-4b5e-941b-e969e9dec533" containerID="66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e" exitCode=0
Sep 11 16:03:58.375138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.374372    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd"
Sep 11 16:03:58.375138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.374392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" event={"ID":"af783023-2976-4b5e-941b-e969e9dec533","Type":"ContainerDied","Data":"66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e"}
Sep 11 16:03:58.375138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.374483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fc4b44c-znwsd" event={"ID":"af783023-2976-4b5e-941b-e969e9dec533","Type":"ContainerDied","Data":"7c7ce85bee760c1f30d7a74776f1922a224fc0fe38762b9e10e6de33bb29ce92"}
Sep 11 16:03:58.375138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.374524    2557 scope.go:117] "RemoveContainer" containerID="66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e"
Sep 11 16:03:58.383980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.383746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"f0bf9e5e23848e6c0a4cec3c518e849a3cc56d689cf976649cbbff3f063d4a30"}
Sep 11 16:03:58.383980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.383806    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"ca194ba09447efbb802f24d284b954f3fc4ed25e0f37f5776d1f2f2db863a4c7"}
Sep 11 16:03:58.383980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.383845    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" event={"ID":"88698f1b-e5e1-44da-9511-350e5916b6b8","Type":"ContainerStarted","Data":"10215ed6f5fbcf62a384240a49f56ea64a1765bab068cd897eddffa55e2f07ef"}
Sep 11 16:03:58.383980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.383927    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:03:58.390231 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.390209    2557 scope.go:117] "RemoveContainer" containerID="66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e"
Sep 11 16:03:58.390536 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:03:58.390507    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e\": container with ID starting with 66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e not found: ID does not exist" containerID="66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e"
Sep 11 16:03:58.390689 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.390546    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e"} err="failed to get container status \"66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e\": rpc error: code = NotFound desc = could not find container \"66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e\": container with ID starting with 66cbf26404d657d3159d9cef959baf79d0ec1beb28717b9307e2e4aada1fac9e not found: ID does not exist"
Sep 11 16:03:58.394878 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394853    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-registry-certificates\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394882    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af783023-2976-4b5e-941b-e969e9dec533-ca-trust-extracted\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394898    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-image-registry-private-configuration\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394918    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af783023-2976-4b5e-941b-e969e9dec533-installation-pull-secrets\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394934    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-registry-tls\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394949    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz9k6\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-kube-api-access-tz9k6\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394962    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af783023-2976-4b5e-941b-e969e9dec533-trusted-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.395058 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.394976    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af783023-2976-4b5e-941b-e969e9dec533-bound-sa-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:03:58.426841 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.426729    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg" podStartSLOduration=2.854550743 podStartE2EDuration="8.426707248s" totalImagesPullingTime="5.572156505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:03:58.423346576 +0000 UTC m=+101.973534429" watchObservedRunningTime="2026-09-11 16:03:58.426707248 +0000 UTC m=+101.976895101"
Sep 11 16:03:58.451853 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.451778    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8fc4b44c-znwsd"]
Sep 11 16:03:58.456745 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.456719    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8fc4b44c-znwsd"]
Sep 11 16:03:58.895193 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:58.895163    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af783023-2976-4b5e-941b-e969e9dec533" path="/var/lib/kubelet/pods/af783023-2976-4b5e-941b-e969e9dec533/volumes"
Sep 11 16:03:59.394911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:03:59.394879    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7498889567-kj7pg"
Sep 11 16:04:01.398772 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:01.398741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"ebd77a11150ffcc47fe85490f8147c360fc006e8da385f4c2ca4717aef2a935f"}
Sep 11 16:04:01.399125 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:01.398832    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"75728a36126c5e4304cbd8a36f878b39a4d7768362c9960b6a58faf9fce44198"}
Sep 11 16:04:02.406201 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:02.406169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"99c3e1e69085f1607fcdb368edba37a6b8601e21accc777f3d9bb66ba1cadbd9"}
Sep 11 16:04:02.406639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:02.406230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"c287f330ca7c8ef71bc2ae9c6b2188b802718c3d2d9775e29e4829cf5865ef8a"}
Sep 11 16:04:02.406639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:02.406256    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"782ba831cac70ecb54314cc365bc539cb363459fd01326e7c89e6c5d3bc5728b"}
Sep 11 16:04:02.406639 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:02.406280    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"26ff7bdb-6253-4196-be2c-7d7999a74daf","Type":"ContainerStarted","Data":"123d6ac4f5840f39b118e14a87d4d6bbedb65e366d0f1792a02ffd76d771e8c8"}
Sep 11 16:04:02.447105 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:02.447020    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.610892471 podStartE2EDuration="8.447001149s" totalImagesPullingTime="5.817573244s" totalInitContainerRuntime="18.535434ms" isStatefulPod=false podCreationTimestamp="2026-09-11 16:03:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:04:02.444845486 +0000 UTC m=+105.995033337" watchObservedRunningTime="2026-09-11 16:04:02.447001149 +0000 UTC m=+105.997189002"
Sep 11 16:04:04.418286 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:04.418258    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:04:11.727992 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:11.727963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-769b995cc4-mf8xv_e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709/router/0.log"
Sep 11 16:04:11.742560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:11.742532    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpqst_1d74b7d8-e76a-4b61-8059-3f210cbc9087/serve-healthcheck-canary/0.log"
Sep 11 16:04:17.472275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:17.472241    2557 generic.go:356] "Generic (PLEG): container finished" podID="2d471cb1-4993-4cce-904c-c99b021b6975" containerID="f3b0aa423bc952ab78f826ece3dca4b4fb6d322a6d0d7c5ef9375c34f4b3daa3" exitCode=0
Sep 11 16:04:17.472721 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:17.472294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x" event={"ID":"2d471cb1-4993-4cce-904c-c99b021b6975","Type":"ContainerDied","Data":"f3b0aa423bc952ab78f826ece3dca4b4fb6d322a6d0d7c5ef9375c34f4b3daa3"}
Sep 11 16:04:17.472721 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:17.472603    2557 scope.go:117] "RemoveContainer" containerID="f3b0aa423bc952ab78f826ece3dca4b4fb6d322a6d0d7c5ef9375c34f4b3daa3"
Sep 11 16:04:18.477336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:18.477302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-86k7x" event={"ID":"2d471cb1-4993-4cce-904c-c99b021b6975","Type":"ContainerStarted","Data":"689644a0a16093a29c6f325d391fad3981e8c90de855f7068929990a7291e08a"}
Sep 11 16:04:54.418559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:54.418526    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:04:54.433755 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:54.433732    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:04:54.632448 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:04:54.632420    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 11 16:07:16.771187 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:16.771139    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:07:16.773145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:16.773110    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:07:16.779254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:16.779233    2557 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 16:07:36.728489 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.728459    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"]
Sep 11 16:07:36.731199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.728942    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af783023-2976-4b5e-941b-e969e9dec533" containerName="registry"
Sep 11 16:07:36.731199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.728957    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af783023-2976-4b5e-941b-e969e9dec533" containerName="registry"
Sep 11 16:07:36.731199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.729010    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af783023-2976-4b5e-941b-e969e9dec533" containerName="registry"
Sep 11 16:07:36.732127 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.732106    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.736638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.736617    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 16:07:36.736728 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.736642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rngc9\""
Sep 11 16:07:36.737149 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.737133    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 16:07:36.737391 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.737377    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 16:07:36.738137 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.738115    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 16:07:36.759923 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.759889    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"]
Sep 11 16:07:36.882784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.882742    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad188a88-f33a-4e73-92ee-216fb4f1993b-webhook-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.882981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.882809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad188a88-f33a-4e73-92ee-216fb4f1993b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.882981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.882844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scqbq\" (UniqueName: \"kubernetes.io/projected/ad188a88-f33a-4e73-92ee-216fb4f1993b-kube-api-access-scqbq\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.882981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.882903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad188a88-f33a-4e73-92ee-216fb4f1993b-tmp\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.882981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.882943    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad188a88-f33a-4e73-92ee-216fb4f1993b-manifests\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.983697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.983597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad188a88-f33a-4e73-92ee-216fb4f1993b-webhook-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.983697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.983684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad188a88-f33a-4e73-92ee-216fb4f1993b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.983931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.983729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scqbq\" (UniqueName: \"kubernetes.io/projected/ad188a88-f33a-4e73-92ee-216fb4f1993b-kube-api-access-scqbq\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.983931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.983779    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad188a88-f33a-4e73-92ee-216fb4f1993b-tmp\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.983931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.983821    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad188a88-f33a-4e73-92ee-216fb4f1993b-manifests\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.984286 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.984266    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad188a88-f33a-4e73-92ee-216fb4f1993b-manifests\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.986032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.986006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad188a88-f33a-4e73-92ee-216fb4f1993b-tmp\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.986180 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.986162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad188a88-f33a-4e73-92ee-216fb4f1993b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.986221 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.986203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad188a88-f33a-4e73-92ee-216fb4f1993b-webhook-cert\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:36.993409 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:36.993389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scqbq\" (UniqueName: \"kubernetes.io/projected/ad188a88-f33a-4e73-92ee-216fb4f1993b-kube-api-access-scqbq\") pod \"opendatahub-operator-controller-manager-58649dcd54-j2b7j\" (UID: \"ad188a88-f33a-4e73-92ee-216fb4f1993b\") " pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:37.042362 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:37.042334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:37.323719 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:37.323691    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"]
Sep 11 16:07:37.326926 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:07:37.326899    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad188a88_f33a_4e73_92ee_216fb4f1993b.slice/crio-769d7f32fc88b23f4bf496113344ecc6528568ad6644e810da59b40481e5f750 WatchSource:0}: Error finding container 769d7f32fc88b23f4bf496113344ecc6528568ad6644e810da59b40481e5f750: Status 404 returned error can't find the container with id 769d7f32fc88b23f4bf496113344ecc6528568ad6644e810da59b40481e5f750
Sep 11 16:07:37.328737 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:37.328721    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:07:38.239593 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:38.239551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j" event={"ID":"ad188a88-f33a-4e73-92ee-216fb4f1993b","Type":"ContainerStarted","Data":"769d7f32fc88b23f4bf496113344ecc6528568ad6644e810da59b40481e5f750"}
Sep 11 16:07:41.254588 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:41.254553    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j" event={"ID":"ad188a88-f33a-4e73-92ee-216fb4f1993b","Type":"ContainerStarted","Data":"09734bc9bb5eb1464373c269ac0ab4d920c97f6cab9647fca8b31e19f2442b2c"}
Sep 11 16:07:42.260444 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:42.260405    2557 generic.go:356] "Generic (PLEG): container finished" podID="ad188a88-f33a-4e73-92ee-216fb4f1993b" containerID="09734bc9bb5eb1464373c269ac0ab4d920c97f6cab9647fca8b31e19f2442b2c" exitCode=0
Sep 11 16:07:42.260811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:42.260481    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j" event={"ID":"ad188a88-f33a-4e73-92ee-216fb4f1993b","Type":"ContainerDied","Data":"09734bc9bb5eb1464373c269ac0ab4d920c97f6cab9647fca8b31e19f2442b2c"}
Sep 11 16:07:43.266965 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:43.266927    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j" event={"ID":"ad188a88-f33a-4e73-92ee-216fb4f1993b","Type":"ContainerStarted","Data":"73c52283f4dfb6274696098e9fe04ee209e26e91a96d8a07d804035872658fb8"}
Sep 11 16:07:43.267393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:43.267055    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:43.289938 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:43.289890    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j" podStartSLOduration=2.550634162 podStartE2EDuration="7.289873399s" totalImagesPullingTime="3.682693577s" totalInitContainerRuntime="1.05654566s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:07:43.287344672 +0000 UTC m=+326.837532527" watchObservedRunningTime="2026-09-11 16:07:43.289873399 +0000 UTC m=+326.840061253"
Sep 11 16:07:54.273496 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:54.273459    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-58649dcd54-j2b7j"
Sep 11 16:07:56.584232 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.584201    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"]
Sep 11 16:07:56.596801 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.596775    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.600098 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.600075    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 16:07:56.600762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.600742    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 16:07:56.600842 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.600741    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:07:56.601114 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.601097    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 16:07:56.601188 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.601097    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 16:07:56.601242 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.601189    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lwq8b\""
Sep 11 16:07:56.605325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.605307    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"]
Sep 11 16:07:56.646937 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.646911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-metrics-cert\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.647091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.646944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-manager-config\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.647091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.646962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-cert\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.647091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.647060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqw46\" (UniqueName: \"kubernetes.io/projected/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-kube-api-access-zqw46\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.747809 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.747771    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-manager-config\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.747809 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.747808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-cert\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.748032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.747860    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqw46\" (UniqueName: \"kubernetes.io/projected/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-kube-api-access-zqw46\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.748032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.747909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-metrics-cert\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.748458 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.748431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-manager-config\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.750459 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.750432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-metrics-cert\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.750555 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.750485    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-cert\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.777300 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.777272    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqw46\" (UniqueName: \"kubernetes.io/projected/e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3-kube-api-access-zqw46\") pod \"lws-controller-manager-7d9ffdf556-fg2nw\" (UID: \"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3\") " pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:56.906534 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:56.906450    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:07:57.188950 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:57.188926    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"]
Sep 11 16:07:57.189993 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:07:57.189963    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d3bfdb_9b37_4a2c_9e99_0b8ca5decbd3.slice/crio-474a561c58d271d822eda3da8e6374022188105d02645d1641d8df1dcff51d4a WatchSource:0}: Error finding container 474a561c58d271d822eda3da8e6374022188105d02645d1641d8df1dcff51d4a: Status 404 returned error can't find the container with id 474a561c58d271d822eda3da8e6374022188105d02645d1641d8df1dcff51d4a
Sep 11 16:07:57.326040 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:07:57.326004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" event={"ID":"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3","Type":"ContainerStarted","Data":"474a561c58d271d822eda3da8e6374022188105d02645d1641d8df1dcff51d4a"}
Sep 11 16:08:00.349016 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:00.348984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" event={"ID":"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3","Type":"ContainerStarted","Data":"ab8b1aa3a6c8f3ebae7689185812e96a6a1a59797b9490e91095392295008df4"}
Sep 11 16:08:00.349435 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:00.349129    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:08:00.367634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:00.367584    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" podStartSLOduration=1.6303350779999999 podStartE2EDuration="4.367569888s" totalImagesPullingTime="2.73723481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:00.365624597 +0000 UTC m=+343.915812451" watchObservedRunningTime="2026-09-11 16:08:00.367569888 +0000 UTC m=+343.917757741"
Sep 11 16:08:04.283446 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.283413    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"]
Sep 11 16:08:04.286916 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.286897    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.290257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.290235    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c6cfs\""
Sep 11 16:08:04.290358 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.290330    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 16:08:04.298477 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.298454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"]
Sep 11 16:08:04.347640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.347609    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"]
Sep 11 16:08:04.350829 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.350813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.376560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.376530    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"]
Sep 11 16:08:04.414545 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414513    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.414742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414552    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.414742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.414742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414606    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b714ea1-0264-47b8-963d-7655c17f39e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.414742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414638    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.414742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.414742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hc5v\" (UniqueName: \"kubernetes.io/projected/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-kube-api-access-8hc5v\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414853    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414881    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.414986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.415056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.415014    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.415349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.415071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.415349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.415099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.415349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.415125    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94p2d\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-kube-api-access-94p2d\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.415349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.415168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516253 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94p2d\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-kube-api-access-94p2d\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.516253 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516477 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516523 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516523 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516513    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.516609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516544    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b714ea1-0264-47b8-963d-7655c17f39e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.516609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516578    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.516609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.516746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hc5v\" (UniqueName: \"kubernetes.io/projected/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-kube-api-access-8hc5v\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516919 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516903    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.516968 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516936    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.516974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517216 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517216 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517216 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517357 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517357 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517357 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517293    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517495 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517495 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517463    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b714ea1-0264-47b8-963d-7655c17f39e0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517589 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517645 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.517781 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517755    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.517873 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.517819    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.519488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.519462    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.519577 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.519462    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.519663 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.519627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.519702 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.519656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.534818 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.534762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.534911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.534813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94p2d\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-kube-api-access-94p2d\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.534911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.534882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.534980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.534943    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hc5v\" (UniqueName: \"kubernetes.io/projected/4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35-kube-api-access-8hc5v\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc\" (UID: \"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.596651 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.596621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:04.660696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.660552    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:04.873472 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.873445    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"]
Sep 11 16:08:04.875870 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:08:04.875836    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b714ea1_0264_47b8_963d_7655c17f39e0.slice/crio-bbeaf320ec2f71b55605ab6f6d2e5ee846df7e54f31ad8bddde3db897974d712 WatchSource:0}: Error finding container bbeaf320ec2f71b55605ab6f6d2e5ee846df7e54f31ad8bddde3db897974d712: Status 404 returned error can't find the container with id bbeaf320ec2f71b55605ab6f6d2e5ee846df7e54f31ad8bddde3db897974d712
Sep 11 16:08:04.936179 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:04.936147    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"]
Sep 11 16:08:04.939402 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:08:04.939377    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4208f9d0_e1f1_4f63_b2ea_452a2cbbfc35.slice/crio-01b46af8e3b6e5c6b30b84682d27ed73abb34a49aed5dbfbe77cbced9ec6482f WatchSource:0}: Error finding container 01b46af8e3b6e5c6b30b84682d27ed73abb34a49aed5dbfbe77cbced9ec6482f: Status 404 returned error can't find the container with id 01b46af8e3b6e5c6b30b84682d27ed73abb34a49aed5dbfbe77cbced9ec6482f
Sep 11 16:08:05.373314 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:05.373275    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc" event={"ID":"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35","Type":"ContainerStarted","Data":"01b46af8e3b6e5c6b30b84682d27ed73abb34a49aed5dbfbe77cbced9ec6482f"}
Sep 11 16:08:05.374472 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:05.374450    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" event={"ID":"6b714ea1-0264-47b8-963d-7655c17f39e0","Type":"ContainerStarted","Data":"bbeaf320ec2f71b55605ab6f6d2e5ee846df7e54f31ad8bddde3db897974d712"}
Sep 11 16:08:08.044502 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.044463    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:08.044789 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.044539    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:08.044789 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.044566    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:08.050688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.050577    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:08.050688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.050662    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:08.050812 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.050710    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:08.392703 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.392659    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc" event={"ID":"4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35","Type":"ContainerStarted","Data":"6b6230c040669f2548d5ff6e4851515558c43943da0d43d59f4e7254b5f61f38"}
Sep 11 16:08:08.394413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.394381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" event={"ID":"6b714ea1-0264-47b8-963d-7655c17f39e0","Type":"ContainerStarted","Data":"33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76"}
Sep 11 16:08:08.413824 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.413775    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc" podStartSLOduration=1.304776003 podStartE2EDuration="4.413757878s" totalImagesPullingTime="3.108981875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:08.412666106 +0000 UTC m=+351.962853961" watchObservedRunningTime="2026-09-11 16:08:08.413757878 +0000 UTC m=+351.963945732"
Sep 11 16:08:08.435758 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.435708    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" podStartSLOduration=1.269394399 podStartE2EDuration="4.435688627s" totalImagesPullingTime="3.166294228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:08.434095039 +0000 UTC m=+351.984282888" watchObservedRunningTime="2026-09-11 16:08:08.435688627 +0000 UTC m=+351.985876480"
Sep 11 16:08:08.596762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.596733    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:08.660901 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:08.660814    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:09.598973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:09.598896    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Sep 11 16:08:09.598973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:09.598949    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Sep 11 16:08:09.665437 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:09.665406    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:10.402653 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:10.402614    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:10.403692 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:10.403674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc"
Sep 11 16:08:10.460679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:10.460636    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"]
Sep 11 16:08:10.597609 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:10.597575    2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused" start-of-body=
Sep 11 16:08:10.597778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:10.597634    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.23:15021/healthz/ready\": dial tcp 10.133.0.23:15021: connect: connection refused"
Sep 11 16:08:11.355902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:11.355867    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:08:11.407150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:11.407096    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerName="istio-proxy" containerID="cri-o://33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76" gracePeriod=30
Sep 11 16:08:15.154696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.154664    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"]
Sep 11 16:08:15.158071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.158033    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.160846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.160815    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 16:08:15.160986 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.160970    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 16:08:15.161254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.161239    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 16:08:15.161340 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.161278    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cvrlv\""
Sep 11 16:08:15.177753 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.177718    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"]
Sep 11 16:08:15.317310 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317275    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8s5d\" (UniqueName: \"kubernetes.io/projected/ab138496-5ed2-4435-b4cb-9dc91c65ab06-kube-api-access-l8s5d\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.317310 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab138496-5ed2-4435-b4cb-9dc91c65ab06-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.317542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.317542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.317542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.317542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.317542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.317485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418133    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8s5d\" (UniqueName: \"kubernetes.io/projected/ab138496-5ed2-4435-b4cb-9dc91c65ab06-kube-api-access-l8s5d\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418252    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab138496-5ed2-4435-b4cb-9dc91c65ab06-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418268    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418313    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.418515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.418352    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.419105 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.419081    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.420647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.420627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab138496-5ed2-4435-b4cb-9dc91c65ab06-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.420823 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.420798    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.421068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.421031    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.421156 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.421142    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.427201 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.427175    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab138496-5ed2-4435-b4cb-9dc91c65ab06-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.427458 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.427442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8s5d\" (UniqueName: \"kubernetes.io/projected/ab138496-5ed2-4435-b4cb-9dc91c65ab06-kube-api-access-l8s5d\") pod \"istiod-openshift-gateway-5677ccb49b-k55b7\" (UID: \"ab138496-5ed2-4435-b4cb-9dc91c65ab06\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.467420 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.467389    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:15.785077 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:15.782182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"]
Sep 11 16:08:15.786935 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:08:15.786894    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab138496_5ed2_4435_b4cb_9dc91c65ab06.slice/crio-a6e9903af0a5c37bb202f73f6348f7a0d89fd4e6f689f953ce97d12f7683b862 WatchSource:0}: Error finding container a6e9903af0a5c37bb202f73f6348f7a0d89fd4e6f689f953ce97d12f7683b862: Status 404 returned error can't find the container with id a6e9903af0a5c37bb202f73f6348f7a0d89fd4e6f689f953ce97d12f7683b862
Sep 11 16:08:16.430540 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.430505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7" event={"ID":"ab138496-5ed2-4435-b4cb-9dc91c65ab06","Type":"ContainerStarted","Data":"a6e9903af0a5c37bb202f73f6348f7a0d89fd4e6f689f953ce97d12f7683b862"}
Sep 11 16:08:16.663166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.663134    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:16.830127 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830084    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-credential-socket\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830150    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-envoy\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830175    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-certs\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830203    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-podinfo\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830246    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94p2d\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-kube-api-access-94p2d\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830308 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830286    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b714ea1-0264-47b8-963d-7655c17f39e0-istiod-ca-cert\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830575 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830316    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-socket\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830575 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830352    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-data\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830575 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830393    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-token\") pod \"6b714ea1-0264-47b8-963d-7655c17f39e0\" (UID: \"6b714ea1-0264-47b8-963d-7655c17f39e0\") "
Sep 11 16:08:16.830769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830384    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:08:16.830769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830509    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:08:16.830769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830707    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b714ea1-0264-47b8-963d-7655c17f39e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:08:16.830928 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830809    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:08:16.831015 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.830975    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:08:16.833234 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.832910    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:08:16.833234 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.832970    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-kube-api-access-94p2d" (OuterVolumeSpecName: "kube-api-access-94p2d") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "kube-api-access-94p2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:08:16.833396 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.833299    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:08:16.833396 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.833379    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b714ea1-0264-47b8-963d-7655c17f39e0" (UID: "6b714ea1-0264-47b8-963d-7655c17f39e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:08:16.931881 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931849    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94p2d\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-kube-api-access-94p2d\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.931881 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931881    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b714ea1-0264-47b8-963d-7655c17f39e0-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931894    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931906    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931917    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931928    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931938    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931950    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b714ea1-0264-47b8-963d-7655c17f39e0-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:16.932081 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:16.931961    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b714ea1-0264-47b8-963d-7655c17f39e0-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:08:17.438176 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.438130    2557 generic.go:356] "Generic (PLEG): container finished" podID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerID="33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76" exitCode=0
Sep 11 16:08:17.438176 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.438179    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" event={"ID":"6b714ea1-0264-47b8-963d-7655c17f39e0","Type":"ContainerDied","Data":"33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76"}
Sep 11 16:08:17.438690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.438190    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"
Sep 11 16:08:17.438690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.438235    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr" event={"ID":"6b714ea1-0264-47b8-963d-7655c17f39e0","Type":"ContainerDied","Data":"bbeaf320ec2f71b55605ab6f6d2e5ee846df7e54f31ad8bddde3db897974d712"}
Sep 11 16:08:17.438690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.438265    2557 scope.go:117] "RemoveContainer" containerID="33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76"
Sep 11 16:08:17.502382 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.502348    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"]
Sep 11 16:08:17.511281 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:17.511246    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcx6bbr"]
Sep 11 16:08:18.229391 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.229275    2557 scope.go:117] "RemoveContainer" containerID="33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76"
Sep 11 16:08:18.229706 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:08:18.229680    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76\": container with ID starting with 33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76 not found: ID does not exist" containerID="33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76"
Sep 11 16:08:18.229829 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.229717    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76"} err="failed to get container status \"33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76\": rpc error: code = NotFound desc = could not find container \"33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76\": container with ID starting with 33b10e6be0e36c3d7e603796863f79bcd4261b35ad05a70a5c3795393991cb76 not found: ID does not exist"
Sep 11 16:08:18.287093 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.287037    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:18.287173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.287124    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:08:18.445330 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.445292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7" event={"ID":"ab138496-5ed2-4435-b4cb-9dc91c65ab06","Type":"ContainerStarted","Data":"caa85778481e2331d675d83d5f1711fa5ed9843a0debe1dc8b6941a5a46b12c0"}
Sep 11 16:08:18.445700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.445372    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:08:18.472461 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.472409    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7" podStartSLOduration=0.974343684 podStartE2EDuration="3.472392047s" totalImagesPullingTime="2.498048363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:08:18.470625438 +0000 UTC m=+362.020813292" watchObservedRunningTime="2026-09-11 16:08:18.472392047 +0000 UTC m=+362.022579900"
Sep 11 16:08:18.898841 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:18.898807    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" path="/var/lib/kubelet/pods/6b714ea1-0264-47b8-963d-7655c17f39e0/volumes"
Sep 11 16:08:19.451513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:08:19.451486    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k55b7"
Sep 11 16:10:27.018648 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.018611    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"]
Sep 11 16:10:27.019105 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.018938    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerName="istio-proxy"
Sep 11 16:10:27.019105 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.018949    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerName="istio-proxy"
Sep 11 16:10:27.019105 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.019017    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b714ea1-0264-47b8-963d-7655c17f39e0" containerName="istio-proxy"
Sep 11 16:10:27.021884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.021867    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.024988 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.024964    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-qfsj6\""
Sep 11 16:10:27.036664 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.036641    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"]
Sep 11 16:10:27.083337 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083337 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083337    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083484    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sgld\" (UniqueName: \"kubernetes.io/projected/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-kube-api-access-7sgld\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083521    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083726 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083637    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.083726 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.083670    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184312 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184312 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184205    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184546 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184627 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184609    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184641    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sgld\" (UniqueName: \"kubernetes.io/projected/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-kube-api-access-7sgld\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184712    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.184944 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184921    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.185014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.184911    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.185151 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.185129    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.186737 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.186713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.186855 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.186836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.195180 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.195160    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sgld\" (UniqueName: \"kubernetes.io/projected/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-kube-api-access-7sgld\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.195564 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.195534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b7nfd\" (UID: \"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.332262 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.332229    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:27.622578 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.622391    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"]
Sep 11 16:10:27.625290 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:10:27.625261    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1daf0b_7ec7_4f21_9d92_1e45bff4f28d.slice/crio-4bf32fac656b255f1b2a54305daf78e94a238eea8ed75569ae907d5ae4a6ba4e WatchSource:0}: Error finding container 4bf32fac656b255f1b2a54305daf78e94a238eea8ed75569ae907d5ae4a6ba4e: Status 404 returned error can't find the container with id 4bf32fac656b255f1b2a54305daf78e94a238eea8ed75569ae907d5ae4a6ba4e
Sep 11 16:10:27.627302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.627272    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:10:27.627376 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.627337    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:10:27.627376 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:27.627370    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:10:28.005909 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:28.005826    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" event={"ID":"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d","Type":"ContainerStarted","Data":"ae87af7657c9a8801eb3e8c824f54b6e5918a89e9c2380f6a880cf5fe0977a2e"}
Sep 11 16:10:28.005909 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:28.005880    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" event={"ID":"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d","Type":"ContainerStarted","Data":"4bf32fac656b255f1b2a54305daf78e94a238eea8ed75569ae907d5ae4a6ba4e"}
Sep 11 16:10:28.332990 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:28.332951    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:28.338587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:28.338561    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:28.369207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:28.369148    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" podStartSLOduration=2.369120861 podStartE2EDuration="2.369120861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:10:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:10:28.044638387 +0000 UTC m=+491.594826240" watchObservedRunningTime="2026-09-11 16:10:28.369120861 +0000 UTC m=+491.919308716"
Sep 11 16:10:29.011406 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:29.011377    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:10:29.012281 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:10:29.012261    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:11:06.271894 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.271862    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c667ccddd-8msmf"]
Sep 11 16:11:06.275388 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.275372    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.280688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.280661    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 16:11:06.280796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.280664    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 16:11:06.280985 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.280972    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 16:11:06.281107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.281090    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5frtc\""
Sep 11 16:11:06.290208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.290186    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c667ccddd-8msmf"]
Sep 11 16:11:06.331697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.331670    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jzbs\" (UniqueName: \"kubernetes.io/projected/6633379c-635d-4d73-8bcf-ebb2f68b4a73-kube-api-access-5jzbs\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.331806 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.331723    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-webhook-cert\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.331806 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.331770    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-metrics-certs\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.432589 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.432555    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-webhook-cert\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.432776 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.432606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-metrics-certs\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.432776 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.432685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jzbs\" (UniqueName: \"kubernetes.io/projected/6633379c-635d-4d73-8bcf-ebb2f68b4a73-kube-api-access-5jzbs\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.435005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.434983    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-metrics-certs\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.435106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.435083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-webhook-cert\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.442824 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.442803    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jzbs\" (UniqueName: \"kubernetes.io/projected/6633379c-635d-4d73-8bcf-ebb2f68b4a73-kube-api-access-5jzbs\") pod \"maas-controller-c667ccddd-8msmf\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") " pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.586193 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.586161    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:06.857865 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:06.857773    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c667ccddd-8msmf"]
Sep 11 16:11:06.862059 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:11:06.862020    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6633379c_635d_4d73_8bcf_ebb2f68b4a73.slice/crio-bec07e1a20ad21c295828a1980f954894fad825544f84e92ef08b486014feb3f WatchSource:0}: Error finding container bec07e1a20ad21c295828a1980f954894fad825544f84e92ef08b486014feb3f: Status 404 returned error can't find the container with id bec07e1a20ad21c295828a1980f954894fad825544f84e92ef08b486014feb3f
Sep 11 16:11:07.177559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:07.177475    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-8msmf" event={"ID":"6633379c-635d-4d73-8bcf-ebb2f68b4a73","Type":"ContainerStarted","Data":"bec07e1a20ad21c295828a1980f954894fad825544f84e92ef08b486014feb3f"}
Sep 11 16:11:10.193365 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:10.193330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-8msmf" event={"ID":"6633379c-635d-4d73-8bcf-ebb2f68b4a73","Type":"ContainerStarted","Data":"d6308f4c4a60a2544632e9316dcddfd3097780ca77d243b2fef7badeb88234b4"}
Sep 11 16:11:10.193780 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:10.193448    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:10.223842 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:10.223792    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c667ccddd-8msmf" podStartSLOduration=1.455377919 podStartE2EDuration="4.223777018s" totalImagesPullingTime="2.768399099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:11:10.222195121 +0000 UTC m=+533.772382974" watchObservedRunningTime="2026-09-11 16:11:10.223777018 +0000 UTC m=+533.773964911"
Sep 11 16:11:21.200063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:21.200018    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:11:43.010290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.010252    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sgpws"]
Sep 11 16:11:43.018087 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.018060    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.021166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.021144    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l865n\""
Sep 11 16:11:43.021271 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.021184    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 16:11:43.029249 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.029224    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sgpws"]
Sep 11 16:11:43.161364 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.161330    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8qs8\" (UniqueName: \"kubernetes.io/projected/04eac8d5-8c67-44e5-9b04-44f2c7693dac-kube-api-access-l8qs8\") pod \"payload-processing-5b54b7fbb7-sgpws\" (UID: \"04eac8d5-8c67-44e5-9b04-44f2c7693dac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.161526 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.161386    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04eac8d5-8c67-44e5-9b04-44f2c7693dac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sgpws\" (UID: \"04eac8d5-8c67-44e5-9b04-44f2c7693dac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.261991 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.261893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8qs8\" (UniqueName: \"kubernetes.io/projected/04eac8d5-8c67-44e5-9b04-44f2c7693dac-kube-api-access-l8qs8\") pod \"payload-processing-5b54b7fbb7-sgpws\" (UID: \"04eac8d5-8c67-44e5-9b04-44f2c7693dac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.261991 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.261981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04eac8d5-8c67-44e5-9b04-44f2c7693dac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sgpws\" (UID: \"04eac8d5-8c67-44e5-9b04-44f2c7693dac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.262752 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.262724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04eac8d5-8c67-44e5-9b04-44f2c7693dac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-sgpws\" (UID: \"04eac8d5-8c67-44e5-9b04-44f2c7693dac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.272719 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.272693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8qs8\" (UniqueName: \"kubernetes.io/projected/04eac8d5-8c67-44e5-9b04-44f2c7693dac-kube-api-access-l8qs8\") pod \"payload-processing-5b54b7fbb7-sgpws\" (UID: \"04eac8d5-8c67-44e5-9b04-44f2c7693dac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.328764 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.328735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:43.616370 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:43.616346    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-sgpws"]
Sep 11 16:11:43.619577 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:11:43.619551    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04eac8d5_8c67_44e5_9b04_44f2c7693dac.slice/crio-5fca5e426462d94e4b1ca90c029c155c6f877d00fd906ed9d1c24a816b96e1f3 WatchSource:0}: Error finding container 5fca5e426462d94e4b1ca90c029c155c6f877d00fd906ed9d1c24a816b96e1f3: Status 404 returned error can't find the container with id 5fca5e426462d94e4b1ca90c029c155c6f877d00fd906ed9d1c24a816b96e1f3
Sep 11 16:11:44.372626 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:44.372550    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws" event={"ID":"04eac8d5-8c67-44e5-9b04-44f2c7693dac","Type":"ContainerStarted","Data":"5fca5e426462d94e4b1ca90c029c155c6f877d00fd906ed9d1c24a816b96e1f3"}
Sep 11 16:11:47.387346 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:47.387312    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws" event={"ID":"04eac8d5-8c67-44e5-9b04-44f2c7693dac","Type":"ContainerStarted","Data":"5244462643f1a13ed35e88c4638bfec3b9b627f921711bfed78f4b6ffdf8e71d"}
Sep 11 16:11:47.387818 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:47.387373    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:47.426290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:47.426240    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws" podStartSLOduration=2.627326808 podStartE2EDuration="5.426215697s" totalImagesPullingTime="2.798888889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:11:47.426167658 +0000 UTC m=+570.976355513" watchObservedRunningTime="2026-09-11 16:11:47.426215697 +0000 UTC m=+570.976403551"
Sep 11 16:11:52.414096 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:52.413991    2557 generic.go:356] "Generic (PLEG): container finished" podID="0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d" containerID="ae87af7657c9a8801eb3e8c824f54b6e5918a89e9c2380f6a880cf5fe0977a2e" exitCode=0
Sep 11 16:11:52.414096 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:52.414036    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" event={"ID":"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d","Type":"ContainerDied","Data":"ae87af7657c9a8801eb3e8c824f54b6e5918a89e9c2380f6a880cf5fe0977a2e"}
Sep 11 16:11:52.414665 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:52.414439    2557 scope.go:117] "RemoveContainer" containerID="ae87af7657c9a8801eb3e8c824f54b6e5918a89e9c2380f6a880cf5fe0977a2e"
Sep 11 16:11:52.415470 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:52.415437    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:11:52.415565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:52.415504    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:11:52.415565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:52.415537    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:11:53.421141 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:53.421108    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" event={"ID":"0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d","Type":"ContainerStarted","Data":"bb21e87b9275a30035cddfbb1891b4a0515ba8d3a39db56a0d5ada8560f681e1"}
Sep 11 16:11:54.333455 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:54.333408    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:11:54.334674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:54.334642    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b7nfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 11 16:11:54.334814 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:54.334715    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" podUID="0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 11 16:11:55.333563 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:55.333532    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b7nfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 11 16:11:55.333910 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:55.333599    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" podUID="0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 11 16:11:56.332840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:56.332803    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b7nfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 11 16:11:56.333021 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:56.332865    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" podUID="0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 11 16:11:57.332972 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:57.332935    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b7nfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 11 16:11:57.333368 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:57.333001    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" podUID="0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 11 16:11:58.333385 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:58.333341    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b7nfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Sep 11 16:11:58.333775 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:58.333403    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd" podUID="0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Sep 11 16:11:58.394258 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:58.394214    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-sgpws"
Sep 11 16:11:59.011451 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:59.011416    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:11:59.337165 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:59.337131    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:11:59.453803 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:11:59.453778    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b7nfd"
Sep 11 16:12:16.801787 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:16.801756    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:12:16.802494 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:16.802475    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:12:42.367516 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.367436    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"]
Sep 11 16:12:42.370752 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.370733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.374357 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.374330    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 16:12:42.374513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.374440    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 16:12:42.374590 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.374545    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zrm4z\""
Sep 11 16:12:42.374754 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.374483    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 16:12:42.381248 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.381225    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"]
Sep 11 16:12:42.396003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.395972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/189917f7-f739-4a49-b53c-298be5ddfc32-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.396132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.396015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.396132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.396060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.396132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.396107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.396132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.396129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.396361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.396188    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgfzm\" (UniqueName: \"kubernetes.io/projected/189917f7-f739-4a49-b53c-298be5ddfc32-kube-api-access-bgfzm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497456 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/189917f7-f739-4a49-b53c-298be5ddfc32-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497475    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgfzm\" (UniqueName: \"kubernetes.io/projected/189917f7-f739-4a49-b53c-298be5ddfc32-kube-api-access-bgfzm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.497959 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.498027 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.497978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.498089 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.498032    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.499926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.499888    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/189917f7-f739-4a49-b53c-298be5ddfc32-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.500224 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.500207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/189917f7-f739-4a49-b53c-298be5ddfc32-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.506659 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.506631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgfzm\" (UniqueName: \"kubernetes.io/projected/189917f7-f739-4a49-b53c-298be5ddfc32-kube-api-access-bgfzm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mpbrw\" (UID: \"189917f7-f739-4a49-b53c-298be5ddfc32\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.683592 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.683505    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:42.957852 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.957827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"]
Sep 11 16:12:42.960074 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:12:42.960032    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189917f7_f739_4a49_b53c_298be5ddfc32.slice/crio-0d4bae1ef831a9321ddbbef9a76a970d11d7b9dd71a695a0717e0c41d48e1e19 WatchSource:0}: Error finding container 0d4bae1ef831a9321ddbbef9a76a970d11d7b9dd71a695a0717e0c41d48e1e19: Status 404 returned error can't find the container with id 0d4bae1ef831a9321ddbbef9a76a970d11d7b9dd71a695a0717e0c41d48e1e19
Sep 11 16:12:42.961361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:42.961338    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:12:43.659962 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:43.659920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw" event={"ID":"189917f7-f739-4a49-b53c-298be5ddfc32","Type":"ContainerStarted","Data":"0d4bae1ef831a9321ddbbef9a76a970d11d7b9dd71a695a0717e0c41d48e1e19"}
Sep 11 16:12:44.666906 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:44.666866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw" event={"ID":"189917f7-f739-4a49-b53c-298be5ddfc32","Type":"ContainerStarted","Data":"ecf025dfb9d7112e48515660697d08de42eea9fc84c4c6f61b0c0c80e37ed698"}
Sep 11 16:12:44.686151 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:44.686103    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw" podStartSLOduration=1.62972126 podStartE2EDuration="2.686086418s" totalImagesPullingTime="1.056365158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:12:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:12:44.685088348 +0000 UTC m=+628.235276203" watchObservedRunningTime="2026-09-11 16:12:44.686086418 +0000 UTC m=+628.236274272"
Sep 11 16:12:52.684241 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:52.684201    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:52.684792 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:52.684271    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:52.696463 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:52.696440    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:12:52.712862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:12:52.712840    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mpbrw"
Sep 11 16:13:29.476930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.476893    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"]
Sep 11 16:13:29.480352 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.480333    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.483628 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.483601    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 16:13:29.496844 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.496818    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"]
Sep 11 16:13:29.509920 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.509894    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.510027 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.509932    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c407c59-2ebe-4606-a519-b73c536c3220-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.510027 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.509961    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btqp2\" (UniqueName: \"kubernetes.io/projected/2c407c59-2ebe-4606-a519-b73c536c3220-kube-api-access-btqp2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.510131 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.510037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.510131 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.510091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.510131 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.510115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.610887 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.610846    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.610887 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.610887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c407c59-2ebe-4606-a519-b73c536c3220-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611169 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.610914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btqp2\" (UniqueName: \"kubernetes.io/projected/2c407c59-2ebe-4606-a519-b73c536c3220-kube-api-access-btqp2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611169 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.610962    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611169 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.611000    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611169 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.611035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611439 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.611404    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611555 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.611453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.611627 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.611591    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.613295 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.613275    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c407c59-2ebe-4606-a519-b73c536c3220-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.613556 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.613539    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c407c59-2ebe-4606-a519-b73c536c3220-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.622723 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.622698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btqp2\" (UniqueName: \"kubernetes.io/projected/2c407c59-2ebe-4606-a519-b73c536c3220-kube-api-access-btqp2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6\" (UID: \"2c407c59-2ebe-4606-a519-b73c536c3220\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:29.790567 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:29.790477    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:30.064830 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:30.064796    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"]
Sep 11 16:13:30.066301 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:13:30.066274    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c407c59_2ebe_4606_a519_b73c536c3220.slice/crio-1c4b874e25251f3e31dff73d269f7d39cf5a5c272e11cf4ae15dc47d0c7bc6ee WatchSource:0}: Error finding container 1c4b874e25251f3e31dff73d269f7d39cf5a5c272e11cf4ae15dc47d0c7bc6ee: Status 404 returned error can't find the container with id 1c4b874e25251f3e31dff73d269f7d39cf5a5c272e11cf4ae15dc47d0c7bc6ee
Sep 11 16:13:30.880509 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:30.880465    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6" event={"ID":"2c407c59-2ebe-4606-a519-b73c536c3220","Type":"ContainerStarted","Data":"55e5336d99528a849f5db5d935ffd87aaa1da044074247d0069c53285e8b2a91"}
Sep 11 16:13:30.880902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:30.880522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6" event={"ID":"2c407c59-2ebe-4606-a519-b73c536c3220","Type":"ContainerStarted","Data":"1c4b874e25251f3e31dff73d269f7d39cf5a5c272e11cf4ae15dc47d0c7bc6ee"}
Sep 11 16:13:30.901372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:30.901322    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6" podStartSLOduration=1.6994661789999999 podStartE2EDuration="1.901306965s" totalImagesPullingTime="201.840786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:13:30.899687257 +0000 UTC m=+674.449875113" watchObservedRunningTime="2026-09-11 16:13:30.901306965 +0000 UTC m=+674.451494823"
Sep 11 16:13:39.791160 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:39.791122    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:39.791618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:39.791208    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:39.803515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:39.803492    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:13:39.933579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:13:39.933548    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6"
Sep 11 16:15:33.192015 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.191979    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"]
Sep 11 16:15:33.196140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.196109    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.199279 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.199255    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-99877a-openshift-default-dockercfg-bnnq7\""
Sep 11 16:15:33.210776 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.210744    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"]
Sep 11 16:15:33.237948 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.237909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-data\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238168 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.237978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx924\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-kube-api-access-jx924\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238168 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-credential-socket\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238168 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-envoy\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238168 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-podinfo\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238213    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-socket\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-certs\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-token\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.238398 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.238365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istiod-ca-cert\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.338777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.338742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-certs\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.338948 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.338792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-token\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.338948 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.338893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istiod-ca-cert\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339023 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.338975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-data\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339023 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx924\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-kube-api-access-jx924\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-credential-socket\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339102    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-envoy\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339133    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-podinfo\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339296 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339163    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-certs\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339296 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339195    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-socket\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339397 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-data\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339456 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-credential-socket\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339554 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339540    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-socket\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.339641 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.339615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istiod-ca-cert\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.341643 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.341620    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-envoy\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.341770 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.341661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-podinfo\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.353531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.353502    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx924\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-kube-api-access-jx924\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.353912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.353883    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-token\") pod \"e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") " pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.509502 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.509414    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:33.792172 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.792076    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"]
Sep 11 16:15:33.796191 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:33.796162    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37ffded_36ba_4ca3_bda0_5b101c5c7805.slice/crio-0db5c8313b8b8e1931bfc12ca8325e218ce430d2fd23128249c43b23636c7fdd WatchSource:0}: Error finding container 0db5c8313b8b8e1931bfc12ca8325e218ce430d2fd23128249c43b23636c7fdd: Status 404 returned error can't find the container with id 0db5c8313b8b8e1931bfc12ca8325e218ce430d2fd23128249c43b23636c7fdd
Sep 11 16:15:33.798290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.798246    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:33.798389 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.798320    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:33.798389 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:33.798349    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:34.465083 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:34.465031    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" event={"ID":"a37ffded-36ba-4ca3-bda0-5b101c5c7805","Type":"ContainerStarted","Data":"3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"}
Sep 11 16:15:34.465497 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:34.465107    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" event={"ID":"a37ffded-36ba-4ca3-bda0-5b101c5c7805","Type":"ContainerStarted","Data":"0db5c8313b8b8e1931bfc12ca8325e218ce430d2fd23128249c43b23636c7fdd"}
Sep 11 16:15:34.495241 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:34.495189    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podStartSLOduration=1.495169883 podStartE2EDuration="1.495169883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:34.493489471 +0000 UTC m=+798.043677339" watchObservedRunningTime="2026-09-11 16:15:34.495169883 +0000 UTC m=+798.045357784"
Sep 11 16:15:34.509842 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:34.509798    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:34.515111 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:34.515081    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:35.469992 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:35.469960    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:35.470828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:35.470806    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:38.784936 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.784900    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"]
Sep 11 16:15:38.793884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.793844    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:38.795478 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.795453    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"]
Sep 11 16:15:38.796638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.796618    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-99877a\""
Sep 11 16:15:38.796731 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.796640    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-99877a-dockercfg-zrqrh\""
Sep 11 16:15:38.798898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.798875    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:38.800322 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.800301    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"]
Sep 11 16:15:38.810346 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.810314    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"]
Sep 11 16:15:38.894714 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.894668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f68e346e-5d5e-4692-8f63-813749794b5a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:38.894902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.894763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78t8j\" (UniqueName: \"kubernetes.io/projected/44582065-bff4-4b1e-9847-4814d079b269-kube-api-access-78t8j\") pod \"payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:38.894902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.894798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pmsz\" (UniqueName: \"kubernetes.io/projected/f68e346e-5d5e-4692-8f63-813749794b5a-kube-api-access-9pmsz\") pod \"payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:38.895029 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.894935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44582065-bff4-4b1e-9847-4814d079b269-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:38.995733 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.995693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78t8j\" (UniqueName: \"kubernetes.io/projected/44582065-bff4-4b1e-9847-4814d079b269-kube-api-access-78t8j\") pod \"payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:38.995733 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.995740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pmsz\" (UniqueName: \"kubernetes.io/projected/f68e346e-5d5e-4692-8f63-813749794b5a-kube-api-access-9pmsz\") pod \"payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:38.995958 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.995795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44582065-bff4-4b1e-9847-4814d079b269-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:38.995958 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.995834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f68e346e-5d5e-4692-8f63-813749794b5a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:38.996624 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.996604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f68e346e-5d5e-4692-8f63-813749794b5a-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:38.996672 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:38.996615    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44582065-bff4-4b1e-9847-4814d079b269-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:39.005320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.005290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pmsz\" (UniqueName: \"kubernetes.io/projected/f68e346e-5d5e-4692-8f63-813749794b5a-kube-api-access-9pmsz\") pod \"payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") " pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:39.005320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.005319    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78t8j\" (UniqueName: \"kubernetes.io/projected/44582065-bff4-4b1e-9847-4814d079b269-kube-api-access-78t8j\") pod \"payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:39.108239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.108205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:39.116531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.116502    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:39.423913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.423889    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"]
Sep 11 16:15:39.425323 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:39.425287    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68e346e_5d5e_4692_8f63_813749794b5a.slice/crio-6c152ddef7a7f7015c4cb101b809e270d15f86138ef1bae407563654099e11f1 WatchSource:0}: Error finding container 6c152ddef7a7f7015c4cb101b809e270d15f86138ef1bae407563654099e11f1: Status 404 returned error can't find the container with id 6c152ddef7a7f7015c4cb101b809e270d15f86138ef1bae407563654099e11f1
Sep 11 16:15:39.429339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.429313    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"]
Sep 11 16:15:39.430494 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:39.430461    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44582065_bff4_4b1e_9847_4814d079b269.slice/crio-6e610f644c2820db6686601081bdace717b2a52eed000394fd20abf6aecf4b22 WatchSource:0}: Error finding container 6e610f644c2820db6686601081bdace717b2a52eed000394fd20abf6aecf4b22: Status 404 returned error can't find the container with id 6e610f644c2820db6686601081bdace717b2a52eed000394fd20abf6aecf4b22
Sep 11 16:15:39.492855 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.492821    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5" event={"ID":"44582065-bff4-4b1e-9847-4814d079b269","Type":"ContainerStarted","Data":"6e610f644c2820db6686601081bdace717b2a52eed000394fd20abf6aecf4b22"}
Sep 11 16:15:39.494577 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.494550    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm" event={"ID":"f68e346e-5d5e-4692-8f63-813749794b5a","Type":"ContainerStarted","Data":"6c152ddef7a7f7015c4cb101b809e270d15f86138ef1bae407563654099e11f1"}
Sep 11 16:15:39.494699 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:39.494685    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:40.501756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:40.501719    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5" event={"ID":"44582065-bff4-4b1e-9847-4814d079b269","Type":"ContainerStarted","Data":"c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a"}
Sep 11 16:15:40.502255 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:40.501785    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:40.503350 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:40.503315    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm" event={"ID":"f68e346e-5d5e-4692-8f63-813749794b5a","Type":"ContainerStarted","Data":"47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e"}
Sep 11 16:15:40.522700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:40.522636    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm" podStartSLOduration=2.522617492 podStartE2EDuration="2.522617492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:39.5314999 +0000 UTC m=+803.081687755" watchObservedRunningTime="2026-09-11 16:15:40.522617492 +0000 UTC m=+804.072805372"
Sep 11 16:15:40.523120 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:40.523087    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5" podStartSLOduration=2.523074665 podStartE2EDuration="2.523074665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:40.520553131 +0000 UTC m=+804.070740986" watchObservedRunningTime="2026-09-11 16:15:40.523074665 +0000 UTC m=+804.073262510"
Sep 11 16:15:41.498024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.497987    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"]
Sep 11 16:15:41.501828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.501803    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.505065 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.505025    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-16046061-openshift-default-dockercfg-zkcgc\""
Sep 11 16:15:41.517715 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.517687    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"]
Sep 11 16:15:41.518835 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.518806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-socket\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.518954 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.518845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctt9b\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-kube-api-access-ctt9b\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.518999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-credential-socket\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519099 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.519059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-token\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519153 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.519095    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-podinfo\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519201 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.519150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-certs\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519247 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.519200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istiod-ca-cert\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519378 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.519356    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-envoy\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.519442 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.519424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-data\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.619932 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.619895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-credential-socket\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.619932 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.619932    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-token\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.619954    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-podinfo\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.619982    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-certs\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istiod-ca-cert\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620108    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-envoy\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-data\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-socket\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctt9b\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-kube-api-access-ctt9b\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620554 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-credential-socket\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620554 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-certs\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620792    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-socket\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620816    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istiod-ca-cert\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.620957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.620885    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-data\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.622537 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.622515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-envoy\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.622618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.622552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-podinfo\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.628920 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.628893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-token\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.629095 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.629077    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctt9b\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-kube-api-access-ctt9b\") pod \"e2e-ait-16046061-openshift-default-58659bf94d-n5wsn\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") " pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:41.813313 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:41.813266    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:42.106566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.106537    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"]
Sep 11 16:15:42.108586 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:42.108551    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd73da2_9286_4c58_b103_6e2ec3014cc2.slice/crio-e71c99af5ba0ac8b09b5cadb052af840f5a6bebe11d7201b544b428f6dee1044 WatchSource:0}: Error finding container e71c99af5ba0ac8b09b5cadb052af840f5a6bebe11d7201b544b428f6dee1044: Status 404 returned error can't find the container with id e71c99af5ba0ac8b09b5cadb052af840f5a6bebe11d7201b544b428f6dee1044
Sep 11 16:15:42.110877 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.110828    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:42.110957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.110919    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:42.110957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.110946    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:42.515844 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.515758    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" event={"ID":"1dd73da2-9286-4c58-b103-6e2ec3014cc2","Type":"ContainerStarted","Data":"967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"}
Sep 11 16:15:42.515844 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.515809    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" event={"ID":"1dd73da2-9286-4c58-b103-6e2ec3014cc2","Type":"ContainerStarted","Data":"e71c99af5ba0ac8b09b5cadb052af840f5a6bebe11d7201b544b428f6dee1044"}
Sep 11 16:15:42.542596 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.542548    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podStartSLOduration=1.5425318479999999 podStartE2EDuration="1.542531848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:42.541293037 +0000 UTC m=+806.091480892" watchObservedRunningTime="2026-09-11 16:15:42.542531848 +0000 UTC m=+806.092719699"
Sep 11 16:15:42.813869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:42.813830    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:43.818929 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:43.818894    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:44.525978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:44.525946    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:44.527093 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:44.527072    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:15:46.495059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.495014    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"]
Sep 11 16:15:46.498871 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.498851    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.501351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.501330    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-16046061-dockercfg-k5cwd\""
Sep 11 16:15:46.501475 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.501363    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-16046061\""
Sep 11 16:15:46.512180 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.512155    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"]
Sep 11 16:15:46.594131 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.594038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vcr\" (UniqueName: \"kubernetes.io/projected/614bdf53-1e2e-4aed-9179-e29c0628bf3d-kube-api-access-45vcr\") pod \"payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.595100 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.595070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/614bdf53-1e2e-4aed-9179-e29c0628bf3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.702486 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.697290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45vcr\" (UniqueName: \"kubernetes.io/projected/614bdf53-1e2e-4aed-9179-e29c0628bf3d-kube-api-access-45vcr\") pod \"payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.702486 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.697365    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/614bdf53-1e2e-4aed-9179-e29c0628bf3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.702486 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.698385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/614bdf53-1e2e-4aed-9179-e29c0628bf3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.710880 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.710852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vcr\" (UniqueName: \"kubernetes.io/projected/614bdf53-1e2e-4aed-9179-e29c0628bf3d-kube-api-access-45vcr\") pod \"payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:46.809996 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:46.809951    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:47.127711 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:47.127683    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614bdf53_1e2e_4aed_9179_e29c0628bf3d.slice/crio-f58688e36f968d6c2ec7bdccd5873a2433bb81e5a28fba585ebd6423e2a603fc WatchSource:0}: Error finding container f58688e36f968d6c2ec7bdccd5873a2433bb81e5a28fba585ebd6423e2a603fc: Status 404 returned error can't find the container with id f58688e36f968d6c2ec7bdccd5873a2433bb81e5a28fba585ebd6423e2a603fc
Sep 11 16:15:47.133150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:47.133120    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"]
Sep 11 16:15:47.552762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:47.552715    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm" event={"ID":"614bdf53-1e2e-4aed-9179-e29c0628bf3d","Type":"ContainerStarted","Data":"ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8"}
Sep 11 16:15:47.553262 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:47.552791    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm" event={"ID":"614bdf53-1e2e-4aed-9179-e29c0628bf3d","Type":"ContainerStarted","Data":"f58688e36f968d6c2ec7bdccd5873a2433bb81e5a28fba585ebd6423e2a603fc"}
Sep 11 16:15:47.553647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:47.553621    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:15:47.596794 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:47.596742    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm" podStartSLOduration=1.5967233859999999 podStartE2EDuration="1.596723386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:47.596548918 +0000 UTC m=+811.146736771" watchObservedRunningTime="2026-09-11 16:15:47.596723386 +0000 UTC m=+811.146911240"
Sep 11 16:15:51.511530 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.511495    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:15:51.511943 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.511593    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:15:51.512177 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.512154    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 16:15:51.512250 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.512205    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:15:51.849093 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.849029    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"]
Sep 11 16:15:51.853710 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.853685    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.858525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.858494    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-b6b139-openshift-default-dockercfg-cmxwt\""
Sep 11 16:15:51.874207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.874166    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"]
Sep 11 16:15:51.950764 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.950722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js9l8\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-kube-api-access-js9l8\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.950949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.950775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-socket\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.950949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.950837    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-podinfo\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.950949 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.950907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-envoy\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.951077 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.950959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-data\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.951077 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.950995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb79dda0-ff65-48f1-b5bd-c03c28456665-istiod-ca-cert\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.951077 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.951028    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-token\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.951203 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.951168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-credential-socket\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:51.951257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:51.951239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-certs\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.052083 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.052011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-credential-socket\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.052396 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.052362    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-certs\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.052653 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.052637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js9l8\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-kube-api-access-js9l8\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.053399 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.053376    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-socket\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.053583 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.053564    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-podinfo\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.054036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-envoy\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.054209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-data\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054378 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.054350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb79dda0-ff65-48f1-b5bd-c03c28456665-istiod-ca-cert\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054513 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.054496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-token\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054712 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.052999    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-credential-socket\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054843 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.053318    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-certs\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.054963 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.053967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-socket\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.055124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.055091    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb79dda0-ff65-48f1-b5bd-c03c28456665-istiod-ca-cert\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.055384 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.055358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-data\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.057160 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.057137    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-envoy\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.057268 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.057144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-podinfo\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.065395 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.065364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"]
Sep 11 16:15:52.069762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.069736    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.073187 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.073161    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js9l8\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-kube-api-access-js9l8\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.081611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.081569    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-e12be0\""
Sep 11 16:15:52.082348 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.082013    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-e12be0-dockercfg-5bgxr\""
Sep 11 16:15:52.085962 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.085938    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-token\") pod \"e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") " pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.092580 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.092531    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"]
Sep 11 16:15:52.156341 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.156298    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52602deb-5f59-4d51-8891-6c2523a00cf4-plugins-config-volume\") pod \"payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") " pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.156534 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.156370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk64b\" (UniqueName: \"kubernetes.io/projected/52602deb-5f59-4d51-8891-6c2523a00cf4-kube-api-access-dk64b\") pod \"payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") " pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.166881 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.166510    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:52.257618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.257380    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52602deb-5f59-4d51-8891-6c2523a00cf4-plugins-config-volume\") pod \"payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") " pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.257618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.257429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk64b\" (UniqueName: \"kubernetes.io/projected/52602deb-5f59-4d51-8891-6c2523a00cf4-kube-api-access-dk64b\") pod \"payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") " pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.258359 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.258306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52602deb-5f59-4d51-8891-6c2523a00cf4-plugins-config-volume\") pod \"payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") " pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.266740 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.266710    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk64b\" (UniqueName: \"kubernetes.io/projected/52602deb-5f59-4d51-8891-6c2523a00cf4-kube-api-access-dk64b\") pod \"payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") " pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.429673 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.429641    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:52.476167 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.476138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"]
Sep 11 16:15:52.484567 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:52.484407    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb79dda0_ff65_48f1_b5bd_c03c28456665.slice/crio-85d3445f05c3d2fb15c3f95f5043e955475be106d0486b0ab4e3be4730b6fb8f WatchSource:0}: Error finding container 85d3445f05c3d2fb15c3f95f5043e955475be106d0486b0ab4e3be4730b6fb8f: Status 404 returned error can't find the container with id 85d3445f05c3d2fb15c3f95f5043e955475be106d0486b0ab4e3be4730b6fb8f
Sep 11 16:15:52.486778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.486735    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:52.486892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.486834    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:52.486959 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.486890    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:52.589086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.588857    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" event={"ID":"cb79dda0-ff65-48f1-b5bd-c03c28456665","Type":"ContainerStarted","Data":"8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"}
Sep 11 16:15:52.589086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.588920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" event={"ID":"cb79dda0-ff65-48f1-b5bd-c03c28456665","Type":"ContainerStarted","Data":"85d3445f05c3d2fb15c3f95f5043e955475be106d0486b0ab4e3be4730b6fb8f"}
Sep 11 16:15:52.591836 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.591806    2557 generic.go:356] "Generic (PLEG): container finished" podID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerID="3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e" exitCode=0
Sep 11 16:15:52.591963 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.591868    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" event={"ID":"a37ffded-36ba-4ca3-bda0-5b101c5c7805","Type":"ContainerDied","Data":"3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"}
Sep 11 16:15:52.592252 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.592237    2557 scope.go:117] "RemoveContainer" containerID="3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"
Sep 11 16:15:52.593793 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.593760    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:52.593874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.593836    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:52.593923 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.593873    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:15:52.630589 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.630526    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podStartSLOduration=1.630499381 podStartE2EDuration="1.630499381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:52.628275644 +0000 UTC m=+816.178463523" watchObservedRunningTime="2026-09-11 16:15:52.630499381 +0000 UTC m=+816.180687238"
Sep 11 16:15:52.719900 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:52.719539    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"]
Sep 11 16:15:52.727758 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:15:52.727680    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52602deb_5f59_4d51_8891_6c2523a00cf4.slice/crio-34c2e05cc1c3f2cff3305470fb3ee16932b47a9087a3c2fad58567365837c0d5 WatchSource:0}: Error finding container 34c2e05cc1c3f2cff3305470fb3ee16932b47a9087a3c2fad58567365837c0d5: Status 404 returned error can't find the container with id 34c2e05cc1c3f2cff3305470fb3ee16932b47a9087a3c2fad58567365837c0d5
Sep 11 16:15:53.167100 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.167011    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:53.172888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.172809    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:53.602610 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.602555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" event={"ID":"a37ffded-36ba-4ca3-bda0-5b101c5c7805","Type":"ContainerStarted","Data":"db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d"}
Sep 11 16:15:53.604389 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.604358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq" event={"ID":"52602deb-5f59-4d51-8891-6c2523a00cf4","Type":"ContainerStarted","Data":"eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9"}
Sep 11 16:15:53.604533 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.604414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq" event={"ID":"52602deb-5f59-4d51-8891-6c2523a00cf4","Type":"ContainerStarted","Data":"34c2e05cc1c3f2cff3305470fb3ee16932b47a9087a3c2fad58567365837c0d5"}
Sep 11 16:15:53.604622 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.604600    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:15:53.604748 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.604662    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:53.605706 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:53.605687    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:15:54.509912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:54.509873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:54.510209 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:54.510182    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 11 16:15:54.510266 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:54.510242    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 11 16:15:55.510134 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:55.510092    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 11 16:15:55.510515 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:55.510151    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 11 16:15:56.510516 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:56.510479    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 11 16:15:56.510906 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:56.510536    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 11 16:15:57.509893 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:57.509848    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 11 16:15:57.510073 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:57.509924    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 11 16:15:58.510218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:58.510189    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Sep 11 16:15:58.510655 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:58.510630    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Sep 11 16:15:59.513713 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:59.513681    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:59.514148 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:59.514083    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:59.514915 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:59.514897    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:15:59.548599 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:59.548511    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq" podStartSLOduration=7.548485904 podStartE2EDuration="7.548485904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:15:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:15:53.703441132 +0000 UTC m=+817.253628987" watchObservedRunningTime="2026-09-11 16:15:59.548485904 +0000 UTC m=+823.098673760"
Sep 11 16:15:59.568767 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:15:59.568715    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:16:00.390600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.390565    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"]
Sep 11 16:16:00.395363 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.395341    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.398217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.398193    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-b6b139-dockercfg-kmk5n\""
Sep 11 16:16:00.398541 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.398520    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-b6b139\""
Sep 11 16:16:00.408634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.408605    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"]
Sep 11 16:16:00.563226 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.563191    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2bp9\" (UniqueName: \"kubernetes.io/projected/8fc90803-66b7-4f04-9bf4-8e88410e1071-kube-api-access-c2bp9\") pod \"payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.563618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.563243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc90803-66b7-4f04-9bf4-8e88410e1071-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.568203 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.568164    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 16:16:00.568347 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.568249    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:16:00.664510 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.664371    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2bp9\" (UniqueName: \"kubernetes.io/projected/8fc90803-66b7-4f04-9bf4-8e88410e1071-kube-api-access-c2bp9\") pod \"payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.664510 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.664446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc90803-66b7-4f04-9bf4-8e88410e1071-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.665271 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.665253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc90803-66b7-4f04-9bf4-8e88410e1071-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.674691 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.674657    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2bp9\" (UniqueName: \"kubernetes.io/projected/8fc90803-66b7-4f04-9bf4-8e88410e1071-kube-api-access-c2bp9\") pod \"payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:00.707790 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:00.707749    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:01.017443 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:01.017415    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"]
Sep 11 16:16:01.019356 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:16:01.019325    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fc90803_66b7_4f04_9bf4_8e88410e1071.slice/crio-37ce0da9a6bf993049b8f30b8ca5b5a803fbc757bd83372f8e00453a1d61b9ff WatchSource:0}: Error finding container 37ce0da9a6bf993049b8f30b8ca5b5a803fbc757bd83372f8e00453a1d61b9ff: Status 404 returned error can't find the container with id 37ce0da9a6bf993049b8f30b8ca5b5a803fbc757bd83372f8e00453a1d61b9ff
Sep 11 16:16:01.652325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:01.652287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf" event={"ID":"8fc90803-66b7-4f04-9bf4-8e88410e1071","Type":"ContainerStarted","Data":"b6c5948ab1f1905610ee3b2b069f617cd3a8871d87a3367fc0a22257541aae37"}
Sep 11 16:16:01.652755 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:01.652346    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf" event={"ID":"8fc90803-66b7-4f04-9bf4-8e88410e1071","Type":"ContainerStarted","Data":"37ce0da9a6bf993049b8f30b8ca5b5a803fbc757bd83372f8e00453a1d61b9ff"}
Sep 11 16:16:01.652755 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:01.652399    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:01.672292 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:01.672222    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf" podStartSLOduration=1.672198013 podStartE2EDuration="1.672198013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:16:01.671795176 +0000 UTC m=+825.221983032" watchObservedRunningTime="2026-09-11 16:16:01.672198013 +0000 UTC m=+825.222385868"
Sep 11 16:16:02.658908 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:02.658874    2557 generic.go:356] "Generic (PLEG): container finished" podID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerID="967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504" exitCode=0
Sep 11 16:16:02.659424 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:02.658947    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" event={"ID":"1dd73da2-9286-4c58-b103-6e2ec3014cc2","Type":"ContainerDied","Data":"967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"}
Sep 11 16:16:02.659520 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:02.659487    2557 scope.go:117] "RemoveContainer" containerID="967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"
Sep 11 16:16:02.660684 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:02.660650    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:16:02.660762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:02.660746    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:16:02.660809 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:02.660795    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:16:03.674242 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:03.670705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" event={"ID":"1dd73da2-9286-4c58-b103-6e2ec3014cc2","Type":"ContainerStarted","Data":"72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49"}
Sep 11 16:16:03.813650 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:03.813610    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:16:03.813855 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:03.813830    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 11 16:16:03.813912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:03.813892    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 11 16:16:04.611961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:04.611931    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:16:04.814429 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:04.814394    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 11 16:16:04.814892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:04.814460    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 11 16:16:05.814651 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:05.814619    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 11 16:16:05.815078 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:05.814675    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 11 16:16:06.814144 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:06.814112    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 11 16:16:06.814324 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:06.814179    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 11 16:16:07.814124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:07.814079    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 11 16:16:07.814496 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:07.814162    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 11 16:16:08.814063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:08.814019    2557 patch_prober.go:28] interesting pod/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused" start-of-body=
Sep 11 16:16:08.814254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:08.814118    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.34:15021/healthz/ready\": dial tcp 10.133.0.34:15021: connect: connection refused"
Sep 11 16:16:09.817601 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:09.817568    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:16:09.818082 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:09.818009    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:16:09.818826 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:09.818802    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:16:10.775693 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:10.775660    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"]
Sep 11 16:16:10.775938 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:10.775906    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm" podUID="614bdf53-1e2e-4aed-9179-e29c0628bf3d" containerName="payload-pre-processing" containerID="cri-o://ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8" gracePeriod=30
Sep 11 16:16:11.182069 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.179978    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:16:11.289070 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.288399    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45vcr\" (UniqueName: \"kubernetes.io/projected/614bdf53-1e2e-4aed-9179-e29c0628bf3d-kube-api-access-45vcr\") pod \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") "
Sep 11 16:16:11.289070 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.288457    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/614bdf53-1e2e-4aed-9179-e29c0628bf3d-plugins-config-volume\") pod \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\" (UID: \"614bdf53-1e2e-4aed-9179-e29c0628bf3d\") "
Sep 11 16:16:11.293068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.289611    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/614bdf53-1e2e-4aed-9179-e29c0628bf3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "614bdf53-1e2e-4aed-9179-e29c0628bf3d" (UID: "614bdf53-1e2e-4aed-9179-e29c0628bf3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:16:11.309309 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.302286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614bdf53-1e2e-4aed-9179-e29c0628bf3d-kube-api-access-45vcr" (OuterVolumeSpecName: "kube-api-access-45vcr") pod "614bdf53-1e2e-4aed-9179-e29c0628bf3d" (UID: "614bdf53-1e2e-4aed-9179-e29c0628bf3d"). InnerVolumeSpecName "kube-api-access-45vcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:16:11.377069 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.377002    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"]
Sep 11 16:16:11.392883 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.392766    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45vcr\" (UniqueName: \"kubernetes.io/projected/614bdf53-1e2e-4aed-9179-e29c0628bf3d-kube-api-access-45vcr\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:11.392883 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.392816    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/614bdf53-1e2e-4aed-9179-e29c0628bf3d-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:11.719999 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.719911    2557 generic.go:356] "Generic (PLEG): container finished" podID="614bdf53-1e2e-4aed-9179-e29c0628bf3d" containerID="ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8" exitCode=0
Sep 11 16:16:11.719999 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.719955    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"
Sep 11 16:16:11.720246 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.720003    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm" event={"ID":"614bdf53-1e2e-4aed-9179-e29c0628bf3d","Type":"ContainerDied","Data":"ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8"}
Sep 11 16:16:11.720246 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.720066    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm" event={"ID":"614bdf53-1e2e-4aed-9179-e29c0628bf3d","Type":"ContainerDied","Data":"f58688e36f968d6c2ec7bdccd5873a2433bb81e5a28fba585ebd6423e2a603fc"}
Sep 11 16:16:11.720246 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.720095    2557 scope.go:117] "RemoveContainer" containerID="ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8"
Sep 11 16:16:11.720503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.720479    2557 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" secret="" err="secret \"e2e-ait-16046061-openshift-default-dockercfg-zkcgc\" not found"
Sep 11 16:16:11.729402 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.729381    2557 scope.go:117] "RemoveContainer" containerID="ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8"
Sep 11 16:16:11.729689 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:16:11.729668    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8\": container with ID starting with ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8 not found: ID does not exist" containerID="ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8"
Sep 11 16:16:11.729760 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.729699    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8"} err="failed to get container status \"ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8\": rpc error: code = NotFound desc = could not find container \"ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8\": container with ID starting with ee06be1bd7dff90751522bfd839cd981cc3a02599406933d3853cdef67c954d8 not found: ID does not exist"
Sep 11 16:16:11.783951 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.783914    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"]
Sep 11 16:16:11.811961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:11.811926    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-16046061-8476478494-k4mzm"]
Sep 11 16:16:12.668290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:12.668248    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:16:12.726988 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:12.726954    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy" containerID="cri-o://72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49" gracePeriod=30
Sep 11 16:16:12.893863 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:12.893809    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="614bdf53-1e2e-4aed-9179-e29c0628bf3d" path="/var/lib/kubelet/pods/614bdf53-1e2e-4aed-9179-e29c0628bf3d/volumes"
Sep 11 16:16:18.011377 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.011349    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:16:18.067670 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.067623    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-podinfo\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.067862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.067686    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctt9b\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-kube-api-access-ctt9b\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.067862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.067729    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istiod-ca-cert\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.067862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.067759    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-credential-socket\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.067862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.067805    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-token\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.068097 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.067968    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-envoy\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.068152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068089    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-socket\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.068215 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-certs\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.068264 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068222    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-data\") pod \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\" (UID: \"1dd73da2-9286-4c58-b103-6e2ec3014cc2\") "
Sep 11 16:16:18.068450 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068280    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:16:18.068450 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068419    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:16:18.068659 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068476    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:16:18.068719 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068697    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-data" (OuterVolumeSpecName: "istio-data") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:16:18.068784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068739    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.068784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068757    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.068784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068771    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.068935 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.068787    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:16:18.070531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.070509    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-token" (OuterVolumeSpecName: "istio-token") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:16:18.070751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.070723    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-kube-api-access-ctt9b" (OuterVolumeSpecName: "kube-api-access-ctt9b") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "kube-api-access-ctt9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:16:18.070871 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.070823    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:16:18.071025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.071001    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1dd73da2-9286-4c58-b103-6e2ec3014cc2" (UID: "1dd73da2-9286-4c58-b103-6e2ec3014cc2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:16:18.170335 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.170290    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.170335 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.170328    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctt9b\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-kube-api-access-ctt9b\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.170335 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.170352    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.170587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.170365    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.170587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.170377    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.170587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.170388    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dd73da2-9286-4c58-b103-6e2ec3014cc2-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:18.761476 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.761437    2557 generic.go:356] "Generic (PLEG): container finished" podID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerID="72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49" exitCode=0
Sep 11 16:16:18.761666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.761508    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"
Sep 11 16:16:18.761666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.761519    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" event={"ID":"1dd73da2-9286-4c58-b103-6e2ec3014cc2","Type":"ContainerDied","Data":"72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49"}
Sep 11 16:16:18.761666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.761605    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn" event={"ID":"1dd73da2-9286-4c58-b103-6e2ec3014cc2","Type":"ContainerDied","Data":"e71c99af5ba0ac8b09b5cadb052af840f5a6bebe11d7201b544b428f6dee1044"}
Sep 11 16:16:18.761666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.761631    2557 scope.go:117] "RemoveContainer" containerID="72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49"
Sep 11 16:16:18.771553 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.771524    2557 scope.go:117] "RemoveContainer" containerID="967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"
Sep 11 16:16:18.780452 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.780427    2557 scope.go:117] "RemoveContainer" containerID="72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49"
Sep 11 16:16:18.780779 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:16:18.780761    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49\": container with ID starting with 72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49 not found: ID does not exist" containerID="72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49"
Sep 11 16:16:18.780826 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.780790    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49"} err="failed to get container status \"72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49\": rpc error: code = NotFound desc = could not find container \"72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49\": container with ID starting with 72ff98aa4e891b7484aac0378ceb86ab906a69421790462f3a1679761274eb49 not found: ID does not exist"
Sep 11 16:16:18.780826 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.780811    2557 scope.go:117] "RemoveContainer" containerID="967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"
Sep 11 16:16:18.781109 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:16:18.781092    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504\": container with ID starting with 967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504 not found: ID does not exist" containerID="967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"
Sep 11 16:16:18.781154 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.781114    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504"} err="failed to get container status \"967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504\": rpc error: code = NotFound desc = could not find container \"967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504\": container with ID starting with 967481758fd9778c8217ae37c57828dd4f5fd222434c9808b9b2960cd8c07504 not found: ID does not exist"
Sep 11 16:16:18.827005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.826972    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"]
Sep 11 16:16:18.880332 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.880300    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-16046061-openshift-default-58659bf94d-n5wsn"]
Sep 11 16:16:18.893441 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:18.893409    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" path="/var/lib/kubelet/pods/1dd73da2-9286-4c58-b103-6e2ec3014cc2/volumes"
Sep 11 16:16:19.768503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:19.768472    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerID="8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85" exitCode=0
Sep 11 16:16:19.769019 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:19.768551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" event={"ID":"cb79dda0-ff65-48f1-b5bd-c03c28456665","Type":"ContainerDied","Data":"8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"}
Sep 11 16:16:19.769117 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:19.769089    2557 scope.go:117] "RemoveContainer" containerID="8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"
Sep 11 16:16:19.770262 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:19.770239    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:16:19.770320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:19.770304    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:16:19.770354 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:19.770337    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:16:20.782864 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:20.782828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" event={"ID":"cb79dda0-ff65-48f1-b5bd-c03c28456665","Type":"ContainerStarted","Data":"4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521"}
Sep 11 16:16:21.168217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:21.167260    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:16:21.168889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:21.168858    2557 patch_prober.go:28] interesting pod/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 11 16:16:21.169013 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:21.168915    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 11 16:16:22.168369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:22.168327    2557 patch_prober.go:28] interesting pod/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 11 16:16:22.168779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:22.168395    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 11 16:16:23.167980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:23.167932    2557 patch_prober.go:28] interesting pod/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 11 16:16:23.168215 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:23.168011    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 11 16:16:23.605314 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:23.605277    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:16:24.168283 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:24.168241    2557 patch_prober.go:28] interesting pod/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 11 16:16:24.168473 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:24.168315    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 11 16:16:25.168138 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:25.168091    2557 patch_prober.go:28] interesting pod/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 11 16:16:25.168581 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:25.168175    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 11 16:16:26.172018 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:26.171988    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:16:26.173005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:26.172987    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:16:45.455769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.455725    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"]
Sep 11 16:16:45.456435 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456413    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614bdf53-1e2e-4aed-9179-e29c0628bf3d" containerName="payload-pre-processing"
Sep 11 16:16:45.456532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456439    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="614bdf53-1e2e-4aed-9179-e29c0628bf3d" containerName="payload-pre-processing"
Sep 11 16:16:45.456532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456472    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy"
Sep 11 16:16:45.456532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456482    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy"
Sep 11 16:16:45.456532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456495    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy"
Sep 11 16:16:45.456532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456504    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy"
Sep 11 16:16:45.456765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456614    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="614bdf53-1e2e-4aed-9179-e29c0628bf3d" containerName="payload-pre-processing"
Sep 11 16:16:45.456765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456629    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy"
Sep 11 16:16:45.456765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.456641    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd73da2-9286-4c58-b103-6e2ec3014cc2" containerName="istio-proxy"
Sep 11 16:16:45.459908 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.459881    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:45.463597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.463573    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:16:45.463931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.463911    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:16:45.480665 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.480632    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"]
Sep 11 16:16:45.547995 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.547947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7\" (UID: \"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:45.648707 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.648661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7\" (UID: \"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:45.649528 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.649502    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7\" (UID: \"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:45.771269 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:45.770880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:46.060145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:46.060112    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"]
Sep 11 16:16:46.062623 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:16:46.062592    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48fcba8c_49f9_4ad3_ab9f_a24b30d373f7.slice/crio-b7653356ef59371c72b3832c0d1de85077cb61d72344bbe26305a3edfcdb303f WatchSource:0}: Error finding container b7653356ef59371c72b3832c0d1de85077cb61d72344bbe26305a3edfcdb303f: Status 404 returned error can't find the container with id b7653356ef59371c72b3832c0d1de85077cb61d72344bbe26305a3edfcdb303f
Sep 11 16:16:46.922797 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:46.922759    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7" event={"ID":"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7","Type":"ContainerStarted","Data":"b7653356ef59371c72b3832c0d1de85077cb61d72344bbe26305a3edfcdb303f"}
Sep 11 16:16:48.934372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:48.934328    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7" event={"ID":"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7","Type":"ContainerStarted","Data":"03714aa59571e40af12e0de0ed53752fa8b919f6cf6e7ea02f8ff4bf00343f5f"}
Sep 11 16:16:48.986640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:48.986586    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7" podStartSLOduration=1.858262444 podStartE2EDuration="3.986568536s" totalImagesPullingTime="2.128306092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:16:48.986235426 +0000 UTC m=+872.536423279" watchObservedRunningTime="2026-09-11 16:16:48.986568536 +0000 UTC m=+872.536756390"
Sep 11 16:16:49.947374 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:49.947331    2557 generic.go:356] "Generic (PLEG): container finished" podID="48fcba8c-49f9-4ad3-ab9f-a24b30d373f7" containerID="03714aa59571e40af12e0de0ed53752fa8b919f6cf6e7ea02f8ff4bf00343f5f" exitCode=0
Sep 11 16:16:49.947773 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:49.947419    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7" event={"ID":"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7","Type":"ContainerDied","Data":"03714aa59571e40af12e0de0ed53752fa8b919f6cf6e7ea02f8ff4bf00343f5f"}
Sep 11 16:16:51.099379 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.099354    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:51.202194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.202161    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7-maas-api-service-ca\") pod \"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7\" (UID: \"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7\") "
Sep 11 16:16:51.202512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.202486    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "48fcba8c-49f9-4ad3-ab9f-a24b30d373f7" (UID: "48fcba8c-49f9-4ad3-ab9f-a24b30d373f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:16:51.303507 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.303466    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:16:51.961068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.961021    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7" event={"ID":"48fcba8c-49f9-4ad3-ab9f-a24b30d373f7","Type":"ContainerDied","Data":"b7653356ef59371c72b3832c0d1de85077cb61d72344bbe26305a3edfcdb303f"}
Sep 11 16:16:51.961068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.961054    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"
Sep 11 16:16:51.961068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:51.961084    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7653356ef59371c72b3832c0d1de85077cb61d72344bbe26305a3edfcdb303f"
Sep 11 16:16:58.471785 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:58.471746    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"]
Sep 11 16:16:58.477440 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:58.477406    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-02a2f652-zvfl7"]
Sep 11 16:16:58.893606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:16:58.893564    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48fcba8c-49f9-4ad3-ab9f-a24b30d373f7" path="/var/lib/kubelet/pods/48fcba8c-49f9-4ad3-ab9f-a24b30d373f7/volumes"
Sep 11 16:17:16.835987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:16.835904    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:17:16.838092 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:16.838071    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:17:28.166685 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.166648    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"]
Sep 11 16:17:28.167082 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.167067    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48fcba8c-49f9-4ad3-ab9f-a24b30d373f7" containerName="revoke-keys"
Sep 11 16:17:28.167132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.167083    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="48fcba8c-49f9-4ad3-ab9f-a24b30d373f7" containerName="revoke-keys"
Sep 11 16:17:28.167167 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.167156    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="48fcba8c-49f9-4ad3-ab9f-a24b30d373f7" containerName="revoke-keys"
Sep 11 16:17:28.174213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.174189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:28.177767 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.177741    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:17:28.177905 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.177848    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:17:28.182188 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.181786    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"]
Sep 11 16:17:28.281869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.281822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d066d630-0a3a-403f-9c26-e34fc0b59a08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj\" (UID: \"d066d630-0a3a-403f-9c26-e34fc0b59a08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:28.382811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.382767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d066d630-0a3a-403f-9c26-e34fc0b59a08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj\" (UID: \"d066d630-0a3a-403f-9c26-e34fc0b59a08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:28.383430 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.383408    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d066d630-0a3a-403f-9c26-e34fc0b59a08-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj\" (UID: \"d066d630-0a3a-403f-9c26-e34fc0b59a08\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:28.486173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.486087    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:28.772909 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:28.772882    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"]
Sep 11 16:17:28.775015 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:17:28.774986    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd066d630_0a3a_403f_9c26_e34fc0b59a08.slice/crio-e8717efbe994fcccf3772f6fac0dc14ef96e20eee5189e9b6f01dbba9f2eb191 WatchSource:0}: Error finding container e8717efbe994fcccf3772f6fac0dc14ef96e20eee5189e9b6f01dbba9f2eb191: Status 404 returned error can't find the container with id e8717efbe994fcccf3772f6fac0dc14ef96e20eee5189e9b6f01dbba9f2eb191
Sep 11 16:17:29.154733 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:29.154698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj" event={"ID":"d066d630-0a3a-403f-9c26-e34fc0b59a08","Type":"ContainerStarted","Data":"f7fe5a06a2fdaa9a77f766d288970d38dbfaf8ecd61588a0c50d54510b2eb501"}
Sep 11 16:17:29.154952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:29.154780    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj" event={"ID":"d066d630-0a3a-403f-9c26-e34fc0b59a08","Type":"ContainerStarted","Data":"e8717efbe994fcccf3772f6fac0dc14ef96e20eee5189e9b6f01dbba9f2eb191"}
Sep 11 16:17:29.174798 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:29.174692    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj" podStartSLOduration=1.174665737 podStartE2EDuration="1.174665737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:17:29.173167072 +0000 UTC m=+912.723354924" watchObservedRunningTime="2026-09-11 16:17:29.174665737 +0000 UTC m=+912.724853592"
Sep 11 16:17:30.161342 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:30.161304    2557 generic.go:356] "Generic (PLEG): container finished" podID="d066d630-0a3a-403f-9c26-e34fc0b59a08" containerID="f7fe5a06a2fdaa9a77f766d288970d38dbfaf8ecd61588a0c50d54510b2eb501" exitCode=0
Sep 11 16:17:30.161559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:30.161354    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj" event={"ID":"d066d630-0a3a-403f-9c26-e34fc0b59a08","Type":"ContainerDied","Data":"f7fe5a06a2fdaa9a77f766d288970d38dbfaf8ecd61588a0c50d54510b2eb501"}
Sep 11 16:17:31.311802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:31.311767    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:31.415668 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:31.415637    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d066d630-0a3a-403f-9c26-e34fc0b59a08-maas-api-service-ca\") pod \"d066d630-0a3a-403f-9c26-e34fc0b59a08\" (UID: \"d066d630-0a3a-403f-9c26-e34fc0b59a08\") "
Sep 11 16:17:31.416085 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:31.416058    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d066d630-0a3a-403f-9c26-e34fc0b59a08-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d066d630-0a3a-403f-9c26-e34fc0b59a08" (UID: "d066d630-0a3a-403f-9c26-e34fc0b59a08"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:17:31.416211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:31.416196    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d066d630-0a3a-403f-9c26-e34fc0b59a08-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:17:32.173291 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:32.173253    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"
Sep 11 16:17:32.173291 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:32.173278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj" event={"ID":"d066d630-0a3a-403f-9c26-e34fc0b59a08","Type":"ContainerDied","Data":"e8717efbe994fcccf3772f6fac0dc14ef96e20eee5189e9b6f01dbba9f2eb191"}
Sep 11 16:17:32.173492 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:32.173326    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8717efbe994fcccf3772f6fac0dc14ef96e20eee5189e9b6f01dbba9f2eb191"
Sep 11 16:17:35.411860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:35.411817    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"]
Sep 11 16:17:35.418640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:35.418607    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-28f629bb-fm4nj"]
Sep 11 16:17:36.893848 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:36.893809    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d066d630-0a3a-403f-9c26-e34fc0b59a08" path="/var/lib/kubelet/pods/d066d630-0a3a-403f-9c26-e34fc0b59a08/volumes"
Sep 11 16:17:46.293302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.293266    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"]
Sep 11 16:17:46.293769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.293736    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d066d630-0a3a-403f-9c26-e34fc0b59a08" containerName="revoke-keys"
Sep 11 16:17:46.293769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.293748    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d066d630-0a3a-403f-9c26-e34fc0b59a08" containerName="revoke-keys"
Sep 11 16:17:46.293875 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.293821    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d066d630-0a3a-403f-9c26-e34fc0b59a08" containerName="revoke-keys"
Sep 11 16:17:46.298695 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.298631    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.304257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.304067    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a9b1abbc-dockercfg-j7r2m\""
Sep 11 16:17:46.304257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.304114    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a9b1abbc\""
Sep 11 16:17:46.322351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.322303    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"]
Sep 11 16:17:46.372762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.372722    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvjpm\" (UniqueName: \"kubernetes.io/projected/991e92db-cdc9-44a3-a0ab-c946f6e9b893-kube-api-access-xvjpm\") pod \"payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") " pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.372940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.372825    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/991e92db-cdc9-44a3-a0ab-c946f6e9b893-plugins-config-volume\") pod \"payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") " pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.473469 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.473433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/991e92db-cdc9-44a3-a0ab-c946f6e9b893-plugins-config-volume\") pod \"payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") " pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.473640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.473550    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvjpm\" (UniqueName: \"kubernetes.io/projected/991e92db-cdc9-44a3-a0ab-c946f6e9b893-kube-api-access-xvjpm\") pod \"payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") " pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.474193 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.474174    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/991e92db-cdc9-44a3-a0ab-c946f6e9b893-plugins-config-volume\") pod \"payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") " pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.485259 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.485232    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvjpm\" (UniqueName: \"kubernetes.io/projected/991e92db-cdc9-44a3-a0ab-c946f6e9b893-kube-api-access-xvjpm\") pod \"payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") " pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.613801 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.613770    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:46.914584 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:46.914558    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"]
Sep 11 16:17:46.915225 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:17:46.915202    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991e92db_cdc9_44a3_a0ab_c946f6e9b893.slice/crio-2202117ffecc470fcf54e7adbefdf68cf33259f13481a8968ef890b11b7dbcba WatchSource:0}: Error finding container 2202117ffecc470fcf54e7adbefdf68cf33259f13481a8968ef890b11b7dbcba: Status 404 returned error can't find the container with id 2202117ffecc470fcf54e7adbefdf68cf33259f13481a8968ef890b11b7dbcba
Sep 11 16:17:47.254107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:47.254001    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4" event={"ID":"991e92db-cdc9-44a3-a0ab-c946f6e9b893","Type":"ContainerStarted","Data":"f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf"}
Sep 11 16:17:47.254107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:47.254083    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:17:47.254107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:47.254104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4" event={"ID":"991e92db-cdc9-44a3-a0ab-c946f6e9b893","Type":"ContainerStarted","Data":"2202117ffecc470fcf54e7adbefdf68cf33259f13481a8968ef890b11b7dbcba"}
Sep 11 16:17:47.319636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:47.319580    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4" podStartSLOduration=1.319562522 podStartE2EDuration="1.319562522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:17:47.318086272 +0000 UTC m=+930.868274134" watchObservedRunningTime="2026-09-11 16:17:47.319562522 +0000 UTC m=+930.869750374"
Sep 11 16:17:58.262020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:17:58.261983    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:18:09.706457 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.706416    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"]
Sep 11 16:18:09.710330 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.710296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:09.718091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.718065    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:18:09.718213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.718141    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:18:09.758293 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.758252    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"]
Sep 11 16:18:09.814270 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.814233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d083bcc2-00f6-4019-bad0-1bbb1d328629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf\" (UID: \"d083bcc2-00f6-4019-bad0-1bbb1d328629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:09.915832 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.915729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d083bcc2-00f6-4019-bad0-1bbb1d328629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf\" (UID: \"d083bcc2-00f6-4019-bad0-1bbb1d328629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:09.916326 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:09.916306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d083bcc2-00f6-4019-bad0-1bbb1d328629-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf\" (UID: \"d083bcc2-00f6-4019-bad0-1bbb1d328629\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:10.020778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:10.020694    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:10.299251 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:10.299226    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"]
Sep 11 16:18:10.300889 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:18:10.300865    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd083bcc2_00f6_4019_bad0_1bbb1d328629.slice/crio-2ab43fd56e63643ede6c986ed41372131bcdd37df90359edd789773cb4cb62eb WatchSource:0}: Error finding container 2ab43fd56e63643ede6c986ed41372131bcdd37df90359edd789773cb4cb62eb: Status 404 returned error can't find the container with id 2ab43fd56e63643ede6c986ed41372131bcdd37df90359edd789773cb4cb62eb
Sep 11 16:18:10.381400 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:10.381359    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf" event={"ID":"d083bcc2-00f6-4019-bad0-1bbb1d328629","Type":"ContainerStarted","Data":"2ab43fd56e63643ede6c986ed41372131bcdd37df90359edd789773cb4cb62eb"}
Sep 11 16:18:11.388343 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:11.388305    2557 generic.go:356] "Generic (PLEG): container finished" podID="d083bcc2-00f6-4019-bad0-1bbb1d328629" containerID="334d33232f0e5884a0eb21c9f0cf7bd7ca9c1b1d3ca6961701968999edc119cb" exitCode=0
Sep 11 16:18:11.388741 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:11.388397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf" event={"ID":"d083bcc2-00f6-4019-bad0-1bbb1d328629","Type":"ContainerDied","Data":"334d33232f0e5884a0eb21c9f0cf7bd7ca9c1b1d3ca6961701968999edc119cb"}
Sep 11 16:18:12.530890 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:12.530865    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:12.641721 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:12.641680    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d083bcc2-00f6-4019-bad0-1bbb1d328629-maas-api-service-ca\") pod \"d083bcc2-00f6-4019-bad0-1bbb1d328629\" (UID: \"d083bcc2-00f6-4019-bad0-1bbb1d328629\") "
Sep 11 16:18:12.642105 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:12.642079    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d083bcc2-00f6-4019-bad0-1bbb1d328629-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d083bcc2-00f6-4019-bad0-1bbb1d328629" (UID: "d083bcc2-00f6-4019-bad0-1bbb1d328629"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:18:12.742729 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:12.742643    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d083bcc2-00f6-4019-bad0-1bbb1d328629-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:18:13.400206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:13.400179    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"
Sep 11 16:18:13.400373 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:13.400174    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf" event={"ID":"d083bcc2-00f6-4019-bad0-1bbb1d328629","Type":"ContainerDied","Data":"2ab43fd56e63643ede6c986ed41372131bcdd37df90359edd789773cb4cb62eb"}
Sep 11 16:18:13.400373 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:13.400308    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ab43fd56e63643ede6c986ed41372131bcdd37df90359edd789773cb4cb62eb"
Sep 11 16:18:22.016937 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.016902    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"]
Sep 11 16:18:22.017419 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.017158    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4" podUID="991e92db-cdc9-44a3-a0ab-c946f6e9b893" containerName="payload-processing" containerID="cri-o://f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf" gracePeriod=30
Sep 11 16:18:22.242661 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.242627    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"]
Sep 11 16:18:22.245473 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.245446    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a9b1abbc-72scf"]
Sep 11 16:18:22.278816 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.278747    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:18:22.436244 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.436212    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvjpm\" (UniqueName: \"kubernetes.io/projected/991e92db-cdc9-44a3-a0ab-c946f6e9b893-kube-api-access-xvjpm\") pod \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") "
Sep 11 16:18:22.436431 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.436324    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/991e92db-cdc9-44a3-a0ab-c946f6e9b893-plugins-config-volume\") pod \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\" (UID: \"991e92db-cdc9-44a3-a0ab-c946f6e9b893\") "
Sep 11 16:18:22.436705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.436671    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/991e92db-cdc9-44a3-a0ab-c946f6e9b893-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "991e92db-cdc9-44a3-a0ab-c946f6e9b893" (UID: "991e92db-cdc9-44a3-a0ab-c946f6e9b893"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:18:22.438259 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.438237    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/991e92db-cdc9-44a3-a0ab-c946f6e9b893-kube-api-access-xvjpm" (OuterVolumeSpecName: "kube-api-access-xvjpm") pod "991e92db-cdc9-44a3-a0ab-c946f6e9b893" (UID: "991e92db-cdc9-44a3-a0ab-c946f6e9b893"). InnerVolumeSpecName "kube-api-access-xvjpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:22.456568 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.456529    2557 generic.go:356] "Generic (PLEG): container finished" podID="991e92db-cdc9-44a3-a0ab-c946f6e9b893" containerID="f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf" exitCode=0
Sep 11 16:18:22.456751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.456573    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"
Sep 11 16:18:22.456751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.456576    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4" event={"ID":"991e92db-cdc9-44a3-a0ab-c946f6e9b893","Type":"ContainerDied","Data":"f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf"}
Sep 11 16:18:22.456751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.456646    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4" event={"ID":"991e92db-cdc9-44a3-a0ab-c946f6e9b893","Type":"ContainerDied","Data":"2202117ffecc470fcf54e7adbefdf68cf33259f13481a8968ef890b11b7dbcba"}
Sep 11 16:18:22.456751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.456679    2557 scope.go:117] "RemoveContainer" containerID="f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf"
Sep 11 16:18:22.470605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.470591    2557 scope.go:117] "RemoveContainer" containerID="f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf"
Sep 11 16:18:22.470960 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:18:22.470939    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf\": container with ID starting with f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf not found: ID does not exist" containerID="f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf"
Sep 11 16:18:22.471034 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.470969    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf"} err="failed to get container status \"f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf\": rpc error: code = NotFound desc = could not find container \"f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf\": container with ID starting with f113fc2157d158c8784b550d6d8efe86515178a8bad2a4ac3fe774cc12d43dbf not found: ID does not exist"
Sep 11 16:18:22.493803 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.493737    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"]
Sep 11 16:18:22.496946 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.496900    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a9b1abbc-78fd7648b9-mnnz4"]
Sep 11 16:18:22.537219 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.537136    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/991e92db-cdc9-44a3-a0ab-c946f6e9b893-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:18:22.537219 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.537162    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvjpm\" (UniqueName: \"kubernetes.io/projected/991e92db-cdc9-44a3-a0ab-c946f6e9b893-kube-api-access-xvjpm\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:18:22.893267 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.893232    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="991e92db-cdc9-44a3-a0ab-c946f6e9b893" path="/var/lib/kubelet/pods/991e92db-cdc9-44a3-a0ab-c946f6e9b893/volumes"
Sep 11 16:18:22.893586 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:22.893573    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d083bcc2-00f6-4019-bad0-1bbb1d328629" path="/var/lib/kubelet/pods/d083bcc2-00f6-4019-bad0-1bbb1d328629/volumes"
Sep 11 16:18:30.013696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.013660    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"]
Sep 11 16:18:30.014349 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.014326    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="991e92db-cdc9-44a3-a0ab-c946f6e9b893" containerName="payload-processing"
Sep 11 16:18:30.014413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.014352    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="991e92db-cdc9-44a3-a0ab-c946f6e9b893" containerName="payload-processing"
Sep 11 16:18:30.014413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.014374    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d083bcc2-00f6-4019-bad0-1bbb1d328629" containerName="revoke-keys"
Sep 11 16:18:30.014413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.014383    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d083bcc2-00f6-4019-bad0-1bbb1d328629" containerName="revoke-keys"
Sep 11 16:18:30.014527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.014511    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="991e92db-cdc9-44a3-a0ab-c946f6e9b893" containerName="payload-processing"
Sep 11 16:18:30.014562 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.014528    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d083bcc2-00f6-4019-bad0-1bbb1d328629" containerName="revoke-keys"
Sep 11 16:18:30.018779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.018762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:30.021632 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.021609    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:18:30.021953 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.021716    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:18:30.028641 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.028606    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"]
Sep 11 16:18:30.111698 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.111657    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18f56420-8da1-42a3-9786-f9272c6f2f51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e12be0-l8hfv\" (UID: \"18f56420-8da1-42a3-9786-f9272c6f2f51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:30.212996 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.212961    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18f56420-8da1-42a3-9786-f9272c6f2f51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e12be0-l8hfv\" (UID: \"18f56420-8da1-42a3-9786-f9272c6f2f51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:30.213611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.213591    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18f56420-8da1-42a3-9786-f9272c6f2f51-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-e12be0-l8hfv\" (UID: \"18f56420-8da1-42a3-9786-f9272c6f2f51\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:30.330874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.330835    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:30.609845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:30.609814    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"]
Sep 11 16:18:30.610952 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:18:30.610927    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f56420_8da1_42a3_9786_f9272c6f2f51.slice/crio-d31554ee7a05365a72d1f82dca645bb5281e4027a2eb301b0c7f43650c7792b4 WatchSource:0}: Error finding container d31554ee7a05365a72d1f82dca645bb5281e4027a2eb301b0c7f43650c7792b4: Status 404 returned error can't find the container with id d31554ee7a05365a72d1f82dca645bb5281e4027a2eb301b0c7f43650c7792b4
Sep 11 16:18:31.510222 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:31.510181    2557 generic.go:356] "Generic (PLEG): container finished" podID="18f56420-8da1-42a3-9786-f9272c6f2f51" containerID="4e590b949648432ec8939dd1b230dc4b1af72642b7eff370a4c4b0249c6dadcc" exitCode=0
Sep 11 16:18:31.510760 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:31.510239    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv" event={"ID":"18f56420-8da1-42a3-9786-f9272c6f2f51","Type":"ContainerDied","Data":"4e590b949648432ec8939dd1b230dc4b1af72642b7eff370a4c4b0249c6dadcc"}
Sep 11 16:18:31.510760 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:31.510278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv" event={"ID":"18f56420-8da1-42a3-9786-f9272c6f2f51","Type":"ContainerStarted","Data":"d31554ee7a05365a72d1f82dca645bb5281e4027a2eb301b0c7f43650c7792b4"}
Sep 11 16:18:32.659587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:32.659559    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:32.739493 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:32.739455    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18f56420-8da1-42a3-9786-f9272c6f2f51-maas-api-service-ca\") pod \"18f56420-8da1-42a3-9786-f9272c6f2f51\" (UID: \"18f56420-8da1-42a3-9786-f9272c6f2f51\") "
Sep 11 16:18:32.739894 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:32.739864    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f56420-8da1-42a3-9786-f9272c6f2f51-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "18f56420-8da1-42a3-9786-f9272c6f2f51" (UID: "18f56420-8da1-42a3-9786-f9272c6f2f51"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:18:32.841119 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:32.841076    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/18f56420-8da1-42a3-9786-f9272c6f2f51-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:18:33.522009 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:33.521979    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"
Sep 11 16:18:33.522213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:33.521984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv" event={"ID":"18f56420-8da1-42a3-9786-f9272c6f2f51","Type":"ContainerDied","Data":"d31554ee7a05365a72d1f82dca645bb5281e4027a2eb301b0c7f43650c7792b4"}
Sep 11 16:18:33.522213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:33.522099    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d31554ee7a05365a72d1f82dca645bb5281e4027a2eb301b0c7f43650c7792b4"
Sep 11 16:18:40.622584 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.622503    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"]
Sep 11 16:18:40.623014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.622771    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq" podUID="52602deb-5f59-4d51-8891-6c2523a00cf4" containerName="payload-processing" containerID="cri-o://eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9" gracePeriod=30
Sep 11 16:18:40.877470 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.877405    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:18:40.883439 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.883412    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"]
Sep 11 16:18:40.911260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.911216    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-e12be0-l8hfv"]
Sep 11 16:18:40.924719 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.924689    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52602deb-5f59-4d51-8891-6c2523a00cf4-plugins-config-volume\") pod \"52602deb-5f59-4d51-8891-6c2523a00cf4\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") "
Sep 11 16:18:40.924918 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.924731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk64b\" (UniqueName: \"kubernetes.io/projected/52602deb-5f59-4d51-8891-6c2523a00cf4-kube-api-access-dk64b\") pod \"52602deb-5f59-4d51-8891-6c2523a00cf4\" (UID: \"52602deb-5f59-4d51-8891-6c2523a00cf4\") "
Sep 11 16:18:40.925128 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.925091    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52602deb-5f59-4d51-8891-6c2523a00cf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52602deb-5f59-4d51-8891-6c2523a00cf4" (UID: "52602deb-5f59-4d51-8891-6c2523a00cf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:18:40.927484 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:40.927453    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52602deb-5f59-4d51-8891-6c2523a00cf4-kube-api-access-dk64b" (OuterVolumeSpecName: "kube-api-access-dk64b") pod "52602deb-5f59-4d51-8891-6c2523a00cf4" (UID: "52602deb-5f59-4d51-8891-6c2523a00cf4"). InnerVolumeSpecName "kube-api-access-dk64b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:18:41.026723 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.026679    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52602deb-5f59-4d51-8891-6c2523a00cf4-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:18:41.026723 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.026723    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk64b\" (UniqueName: \"kubernetes.io/projected/52602deb-5f59-4d51-8891-6c2523a00cf4-kube-api-access-dk64b\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:18:41.567146 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.567109    2557 generic.go:356] "Generic (PLEG): container finished" podID="52602deb-5f59-4d51-8891-6c2523a00cf4" containerID="eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9" exitCode=0
Sep 11 16:18:41.567361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.567155    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"
Sep 11 16:18:41.567361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.567198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq" event={"ID":"52602deb-5f59-4d51-8891-6c2523a00cf4","Type":"ContainerDied","Data":"eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9"}
Sep 11 16:18:41.567361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.567262    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq" event={"ID":"52602deb-5f59-4d51-8891-6c2523a00cf4","Type":"ContainerDied","Data":"34c2e05cc1c3f2cff3305470fb3ee16932b47a9087a3c2fad58567365837c0d5"}
Sep 11 16:18:41.567361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.567295    2557 scope.go:117] "RemoveContainer" containerID="eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9"
Sep 11 16:18:41.576329 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.576310    2557 scope.go:117] "RemoveContainer" containerID="eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9"
Sep 11 16:18:41.576649 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:18:41.576631    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9\": container with ID starting with eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9 not found: ID does not exist" containerID="eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9"
Sep 11 16:18:41.576705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.576660    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9"} err="failed to get container status \"eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9\": rpc error: code = NotFound desc = could not find container \"eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9\": container with ID starting with eb31d5dba88cf9842b4a891c9e01c27ac11792c977eb807bfc81113f8e5094e9 not found: ID does not exist"
Sep 11 16:18:41.600495 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.600461    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"]
Sep 11 16:18:41.605543 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:41.605515    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-e12be0-5d57484f9f-g6ljq"]
Sep 11 16:18:42.892320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:42.892279    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f56420-8da1-42a3-9786-f9272c6f2f51" path="/var/lib/kubelet/pods/18f56420-8da1-42a3-9786-f9272c6f2f51/volumes"
Sep 11 16:18:42.892834 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:18:42.892815    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52602deb-5f59-4d51-8891-6c2523a00cf4" path="/var/lib/kubelet/pods/52602deb-5f59-4d51-8891-6c2523a00cf4/volumes"
Sep 11 16:19:42.173580 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.173537    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"]
Sep 11 16:19:42.174061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.173941    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52602deb-5f59-4d51-8891-6c2523a00cf4" containerName="payload-processing"
Sep 11 16:19:42.174061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.173953    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="52602deb-5f59-4d51-8891-6c2523a00cf4" containerName="payload-processing"
Sep 11 16:19:42.174061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.173963    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f56420-8da1-42a3-9786-f9272c6f2f51" containerName="revoke-keys"
Sep 11 16:19:42.174061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.173968    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f56420-8da1-42a3-9786-f9272c6f2f51" containerName="revoke-keys"
Sep 11 16:19:42.174061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.174054    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="18f56420-8da1-42a3-9786-f9272c6f2f51" containerName="revoke-keys"
Sep 11 16:19:42.174061 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.174067    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="52602deb-5f59-4d51-8891-6c2523a00cf4" containerName="payload-processing"
Sep 11 16:19:42.178583 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.178558    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:42.181614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.181575    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:19:42.181614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.181609    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:19:42.191791 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.191758    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"]
Sep 11 16:19:42.323400 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.323364    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5\" (UID: \"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:42.424845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.424757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5\" (UID: \"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:42.425442 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.425423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5\" (UID: \"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:42.490566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.490526    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:42.769857 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.769831    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"]
Sep 11 16:19:42.772036 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:19:42.772005    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec0c3c4_4a68_46c5_9d58_8a0c614ae595.slice/crio-2b44487a581048319cfe9bca5f2987ded53c4dd68f908a8c62432a51911a20bf WatchSource:0}: Error finding container 2b44487a581048319cfe9bca5f2987ded53c4dd68f908a8c62432a51911a20bf: Status 404 returned error can't find the container with id 2b44487a581048319cfe9bca5f2987ded53c4dd68f908a8c62432a51911a20bf
Sep 11 16:19:42.895463 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:42.895412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5" event={"ID":"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595","Type":"ContainerStarted","Data":"2b44487a581048319cfe9bca5f2987ded53c4dd68f908a8c62432a51911a20bf"}
Sep 11 16:19:43.896787 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:43.896755    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ec0c3c4-4a68-46c5-9d58-8a0c614ae595" containerID="616998ccfe32d983143038c914ce8ab1ab467b6b36ab9bb0fc06a749e8f7b5c5" exitCode=0
Sep 11 16:19:43.897186 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:43.896814    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5" event={"ID":"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595","Type":"ContainerDied","Data":"616998ccfe32d983143038c914ce8ab1ab467b6b36ab9bb0fc06a749e8f7b5c5"}
Sep 11 16:19:45.036836 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.036808    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:45.153638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.153543    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595-maas-api-service-ca\") pod \"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595\" (UID: \"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595\") "
Sep 11 16:19:45.153932 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.153909    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8ec0c3c4-4a68-46c5-9d58-8a0c614ae595" (UID: "8ec0c3c4-4a68-46c5-9d58-8a0c614ae595"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:19:45.254549 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.254511    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:19:45.908622 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.908592    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"
Sep 11 16:19:45.908796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.908589    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5" event={"ID":"8ec0c3c4-4a68-46c5-9d58-8a0c614ae595","Type":"ContainerDied","Data":"2b44487a581048319cfe9bca5f2987ded53c4dd68f908a8c62432a51911a20bf"}
Sep 11 16:19:45.908796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:45.908726    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b44487a581048319cfe9bca5f2987ded53c4dd68f908a8c62432a51911a20bf"
Sep 11 16:19:52.920687 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:52.920657    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"]
Sep 11 16:19:52.922444 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:52.922422    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8a7a3a-x84t5"]
Sep 11 16:19:54.892797 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:19:54.892765    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec0c3c4-4a68-46c5-9d58-8a0c614ae595" path="/var/lib/kubelet/pods/8ec0c3c4-4a68-46c5-9d58-8a0c614ae595/volumes"
Sep 11 16:20:15.346344 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.346260    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"]
Sep 11 16:20:15.346786 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.346658    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec0c3c4-4a68-46c5-9d58-8a0c614ae595" containerName="revoke-keys"
Sep 11 16:20:15.346786 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.346670    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec0c3c4-4a68-46c5-9d58-8a0c614ae595" containerName="revoke-keys"
Sep 11 16:20:15.346786 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.346744    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec0c3c4-4a68-46c5-9d58-8a0c614ae595" containerName="revoke-keys"
Sep 11 16:20:15.349757 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.349742    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.353033 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.353013    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3882e47c\""
Sep 11 16:20:15.375336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.375307    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"]
Sep 11 16:20:15.440676 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.440640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-plugins-config-volume\") pod \"payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") " pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.440676 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.440682    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5djwc\" (UniqueName: \"kubernetes.io/projected/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-kube-api-access-5djwc\") pod \"payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") " pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.541902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.541862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-plugins-config-volume\") pod \"payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") " pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.541902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.541907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5djwc\" (UniqueName: \"kubernetes.io/projected/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-kube-api-access-5djwc\") pod \"payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") " pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.542696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.542676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-plugins-config-volume\") pod \"payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") " pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.556942 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.556915    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5djwc\" (UniqueName: \"kubernetes.io/projected/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-kube-api-access-5djwc\") pod \"payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") " pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.660090 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.659990    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:15.950623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:15.950599    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"]
Sep 11 16:20:15.952777 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:20:15.952750    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81c9e9b_c34d_4ebd_aa9b_9335baaaadf9.slice/crio-51ab006e621e4db891378fd7d50f1adba4e573dc1319b458174e444de431c6e2 WatchSource:0}: Error finding container 51ab006e621e4db891378fd7d50f1adba4e573dc1319b458174e444de431c6e2: Status 404 returned error can't find the container with id 51ab006e621e4db891378fd7d50f1adba4e573dc1319b458174e444de431c6e2
Sep 11 16:20:16.066743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:16.066705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl" event={"ID":"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9","Type":"ContainerStarted","Data":"df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0"}
Sep 11 16:20:16.066920 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:16.066768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl" event={"ID":"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9","Type":"ContainerStarted","Data":"51ab006e621e4db891378fd7d50f1adba4e573dc1319b458174e444de431c6e2"}
Sep 11 16:20:16.066920 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:16.066795    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:16.127392 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:16.127337    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl" podStartSLOduration=1.127317647 podStartE2EDuration="1.127317647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:20:16.115410928 +0000 UTC m=+1079.665598780" watchObservedRunningTime="2026-09-11 16:20:16.127317647 +0000 UTC m=+1079.677505497"
Sep 11 16:20:23.919736 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:23.919699    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"]
Sep 11 16:20:23.923425 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:23.923408    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:23.926224 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:23.926205    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:20:23.928439 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:23.928420    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:20:23.941369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:23.941338    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"]
Sep 11 16:20:24.027535 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:24.027495    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7103f8c9-e63c-4d72-b6c0-dd5380be9b27-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-99877a-gljsg\" (UID: \"7103f8c9-e63c-4d72-b6c0-dd5380be9b27\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:24.129011 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:24.128971    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7103f8c9-e63c-4d72-b6c0-dd5380be9b27-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-99877a-gljsg\" (UID: \"7103f8c9-e63c-4d72-b6c0-dd5380be9b27\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:24.129604 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:24.129575    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7103f8c9-e63c-4d72-b6c0-dd5380be9b27-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-99877a-gljsg\" (UID: \"7103f8c9-e63c-4d72-b6c0-dd5380be9b27\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:24.232904 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:24.232815    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:24.526696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:24.526664    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"]
Sep 11 16:20:24.528691 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:20:24.528667    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7103f8c9_e63c_4d72_b6c0_dd5380be9b27.slice/crio-f9b9c002a7cb62a5806eb813220219af0d45517554e048808d3b77cd830c2d1a WatchSource:0}: Error finding container f9b9c002a7cb62a5806eb813220219af0d45517554e048808d3b77cd830c2d1a: Status 404 returned error can't find the container with id f9b9c002a7cb62a5806eb813220219af0d45517554e048808d3b77cd830c2d1a
Sep 11 16:20:25.117260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:25.117160    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg" event={"ID":"7103f8c9-e63c-4d72-b6c0-dd5380be9b27","Type":"ContainerStarted","Data":"de4eb9f4c0c9a148eb6a0e0d1c75139a8bc690f188128683f83f90eb7c0734d3"}
Sep 11 16:20:25.117260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:25.117230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg" event={"ID":"7103f8c9-e63c-4d72-b6c0-dd5380be9b27","Type":"ContainerStarted","Data":"f9b9c002a7cb62a5806eb813220219af0d45517554e048808d3b77cd830c2d1a"}
Sep 11 16:20:25.149756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:25.149697    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg" podStartSLOduration=2.149678939 podStartE2EDuration="2.149678939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:20:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:20:25.148115191 +0000 UTC m=+1088.698303044" watchObservedRunningTime="2026-09-11 16:20:25.149678939 +0000 UTC m=+1088.699866791"
Sep 11 16:20:26.124594 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:26.124556    2557 generic.go:356] "Generic (PLEG): container finished" podID="7103f8c9-e63c-4d72-b6c0-dd5380be9b27" containerID="de4eb9f4c0c9a148eb6a0e0d1c75139a8bc690f188128683f83f90eb7c0734d3" exitCode=0
Sep 11 16:20:26.124594 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:26.124595    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg" event={"ID":"7103f8c9-e63c-4d72-b6c0-dd5380be9b27","Type":"ContainerDied","Data":"de4eb9f4c0c9a148eb6a0e0d1c75139a8bc690f188128683f83f90eb7c0734d3"}
Sep 11 16:20:27.075243 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:27.075211    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:27.270587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:27.270560    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:27.363843 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:27.363738    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7103f8c9-e63c-4d72-b6c0-dd5380be9b27-maas-api-service-ca\") pod \"7103f8c9-e63c-4d72-b6c0-dd5380be9b27\" (UID: \"7103f8c9-e63c-4d72-b6c0-dd5380be9b27\") "
Sep 11 16:20:27.364106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:27.364081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7103f8c9-e63c-4d72-b6c0-dd5380be9b27-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7103f8c9-e63c-4d72-b6c0-dd5380be9b27" (UID: "7103f8c9-e63c-4d72-b6c0-dd5380be9b27"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:27.465489 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:27.465449    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7103f8c9-e63c-4d72-b6c0-dd5380be9b27-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:28.136484 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:28.136451    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"
Sep 11 16:20:28.136665 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:28.136452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg" event={"ID":"7103f8c9-e63c-4d72-b6c0-dd5380be9b27","Type":"ContainerDied","Data":"f9b9c002a7cb62a5806eb813220219af0d45517554e048808d3b77cd830c2d1a"}
Sep 11 16:20:28.136665 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:28.136575    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9b9c002a7cb62a5806eb813220219af0d45517554e048808d3b77cd830c2d1a"
Sep 11 16:20:34.793111 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:34.793067    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"]
Sep 11 16:20:34.793553 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:34.793371    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm" podUID="f68e346e-5d5e-4692-8f63-813749794b5a" containerName="payload-processing" containerID="cri-o://47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e" gracePeriod=30
Sep 11 16:20:34.803067 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:34.803012    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"]
Sep 11 16:20:34.803336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:34.803306    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5" podUID="44582065-bff4-4b1e-9847-4814d079b269" containerName="payload-pre-processing" containerID="cri-o://c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a" gracePeriod=30
Sep 11 16:20:35.026705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.026632    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"]
Sep 11 16:20:35.030059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.030017    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-99877a-gljsg"]
Sep 11 16:20:35.078469 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.078439    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:20:35.101846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.101817    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:20:35.143618 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.143583    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pmsz\" (UniqueName: \"kubernetes.io/projected/f68e346e-5d5e-4692-8f63-813749794b5a-kube-api-access-9pmsz\") pod \"f68e346e-5d5e-4692-8f63-813749794b5a\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") "
Sep 11 16:20:35.143796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.143630    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44582065-bff4-4b1e-9847-4814d079b269-plugins-config-volume\") pod \"44582065-bff4-4b1e-9847-4814d079b269\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") "
Sep 11 16:20:35.143796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.143708    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f68e346e-5d5e-4692-8f63-813749794b5a-plugins-config-volume\") pod \"f68e346e-5d5e-4692-8f63-813749794b5a\" (UID: \"f68e346e-5d5e-4692-8f63-813749794b5a\") "
Sep 11 16:20:35.143796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.143765    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78t8j\" (UniqueName: \"kubernetes.io/projected/44582065-bff4-4b1e-9847-4814d079b269-kube-api-access-78t8j\") pod \"44582065-bff4-4b1e-9847-4814d079b269\" (UID: \"44582065-bff4-4b1e-9847-4814d079b269\") "
Sep 11 16:20:35.144097 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.144065    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44582065-bff4-4b1e-9847-4814d079b269-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44582065-bff4-4b1e-9847-4814d079b269" (UID: "44582065-bff4-4b1e-9847-4814d079b269"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:35.144185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.144143    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44582065-bff4-4b1e-9847-4814d079b269-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:35.144427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.144402    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f68e346e-5d5e-4692-8f63-813749794b5a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f68e346e-5d5e-4692-8f63-813749794b5a" (UID: "f68e346e-5d5e-4692-8f63-813749794b5a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:35.145807 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.145779    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44582065-bff4-4b1e-9847-4814d079b269-kube-api-access-78t8j" (OuterVolumeSpecName: "kube-api-access-78t8j") pod "44582065-bff4-4b1e-9847-4814d079b269" (UID: "44582065-bff4-4b1e-9847-4814d079b269"). InnerVolumeSpecName "kube-api-access-78t8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:35.146213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.146193    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68e346e-5d5e-4692-8f63-813749794b5a-kube-api-access-9pmsz" (OuterVolumeSpecName: "kube-api-access-9pmsz") pod "f68e346e-5d5e-4692-8f63-813749794b5a" (UID: "f68e346e-5d5e-4692-8f63-813749794b5a"). InnerVolumeSpecName "kube-api-access-9pmsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:35.174198 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.174163    2557 generic.go:356] "Generic (PLEG): container finished" podID="f68e346e-5d5e-4692-8f63-813749794b5a" containerID="47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e" exitCode=0
Sep 11 16:20:35.174393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.174233    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"
Sep 11 16:20:35.174393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.174249    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm" event={"ID":"f68e346e-5d5e-4692-8f63-813749794b5a","Type":"ContainerDied","Data":"47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e"}
Sep 11 16:20:35.174393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.174335    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm" event={"ID":"f68e346e-5d5e-4692-8f63-813749794b5a","Type":"ContainerDied","Data":"6c152ddef7a7f7015c4cb101b809e270d15f86138ef1bae407563654099e11f1"}
Sep 11 16:20:35.174393 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.174364    2557 scope.go:117] "RemoveContainer" containerID="47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e"
Sep 11 16:20:35.175649 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.175629    2557 generic.go:356] "Generic (PLEG): container finished" podID="44582065-bff4-4b1e-9847-4814d079b269" containerID="c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a" exitCode=0
Sep 11 16:20:35.175730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.175682    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"
Sep 11 16:20:35.175777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.175686    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5" event={"ID":"44582065-bff4-4b1e-9847-4814d079b269","Type":"ContainerDied","Data":"c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a"}
Sep 11 16:20:35.175821 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.175796    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5" event={"ID":"44582065-bff4-4b1e-9847-4814d079b269","Type":"ContainerDied","Data":"6e610f644c2820db6686601081bdace717b2a52eed000394fd20abf6aecf4b22"}
Sep 11 16:20:35.184625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.184606    2557 scope.go:117] "RemoveContainer" containerID="47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e"
Sep 11 16:20:35.184914 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:20:35.184895    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e\": container with ID starting with 47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e not found: ID does not exist" containerID="47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e"
Sep 11 16:20:35.184980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.184922    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e"} err="failed to get container status \"47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e\": rpc error: code = NotFound desc = could not find container \"47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e\": container with ID starting with 47e1d4a570fdfc13a50c8e36f843c8837325dcf9bf54cc8fcd0f182e774dff2e not found: ID does not exist"
Sep 11 16:20:35.184980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.184940    2557 scope.go:117] "RemoveContainer" containerID="c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a"
Sep 11 16:20:35.192964 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.192945    2557 scope.go:117] "RemoveContainer" containerID="c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a"
Sep 11 16:20:35.193225 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:20:35.193204    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a\": container with ID starting with c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a not found: ID does not exist" containerID="c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a"
Sep 11 16:20:35.193286 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.193234    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a"} err="failed to get container status \"c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a\": rpc error: code = NotFound desc = could not find container \"c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a\": container with ID starting with c63228e73ebdf47e3ddf0c6219d8f8fd65404c724526c41f3dc56b4c26c4877a not found: ID does not exist"
Sep 11 16:20:35.203110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.203084    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"]
Sep 11 16:20:35.209217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.209195    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-99877a-57dbf85595-l56jm"]
Sep 11 16:20:35.220252 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.220229    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"]
Sep 11 16:20:35.226936 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.226912    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-99877a-57874c9746-4q8x5"]
Sep 11 16:20:35.245254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.245227    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f68e346e-5d5e-4692-8f63-813749794b5a-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:35.245254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.245252    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78t8j\" (UniqueName: \"kubernetes.io/projected/44582065-bff4-4b1e-9847-4814d079b269-kube-api-access-78t8j\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:35.245432 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:35.245267    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pmsz\" (UniqueName: \"kubernetes.io/projected/f68e346e-5d5e-4692-8f63-813749794b5a-kube-api-access-9pmsz\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:36.892483 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:36.892452    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44582065-bff4-4b1e-9847-4814d079b269" path="/var/lib/kubelet/pods/44582065-bff4-4b1e-9847-4814d079b269/volumes"
Sep 11 16:20:36.892844 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:36.892767    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7103f8c9-e63c-4d72-b6c0-dd5380be9b27" path="/var/lib/kubelet/pods/7103f8c9-e63c-4d72-b6c0-dd5380be9b27/volumes"
Sep 11 16:20:36.893103 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:36.893090    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f68e346e-5d5e-4692-8f63-813749794b5a" path="/var/lib/kubelet/pods/f68e346e-5d5e-4692-8f63-813749794b5a/volumes"
Sep 11 16:20:38.710945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.710905    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"]
Sep 11 16:20:38.711388 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711373    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44582065-bff4-4b1e-9847-4814d079b269" containerName="payload-pre-processing"
Sep 11 16:20:38.711427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711390    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="44582065-bff4-4b1e-9847-4814d079b269" containerName="payload-pre-processing"
Sep 11 16:20:38.711427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711407    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f68e346e-5d5e-4692-8f63-813749794b5a" containerName="payload-processing"
Sep 11 16:20:38.711427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711413    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f68e346e-5d5e-4692-8f63-813749794b5a" containerName="payload-processing"
Sep 11 16:20:38.711427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711423    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7103f8c9-e63c-4d72-b6c0-dd5380be9b27" containerName="revoke-keys"
Sep 11 16:20:38.711427 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711428    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7103f8c9-e63c-4d72-b6c0-dd5380be9b27" containerName="revoke-keys"
Sep 11 16:20:38.711590 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711495    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f68e346e-5d5e-4692-8f63-813749794b5a" containerName="payload-processing"
Sep 11 16:20:38.711590 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711505    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="44582065-bff4-4b1e-9847-4814d079b269" containerName="payload-pre-processing"
Sep 11 16:20:38.711590 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.711514    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7103f8c9-e63c-4d72-b6c0-dd5380be9b27" containerName="revoke-keys"
Sep 11 16:20:38.716157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.716139    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:38.720325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.720303    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:20:38.728021 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.727998    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:20:38.759102 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.759064    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"]
Sep 11 16:20:38.782834 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.782798    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c2eb925-168c-43cb-a248-79b9f4f288ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q\" (UID: \"5c2eb925-168c-43cb-a248-79b9f4f288ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:38.884234 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.884200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c2eb925-168c-43cb-a248-79b9f4f288ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q\" (UID: \"5c2eb925-168c-43cb-a248-79b9f4f288ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:38.884801 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:38.884778    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c2eb925-168c-43cb-a248-79b9f4f288ed-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q\" (UID: \"5c2eb925-168c-43cb-a248-79b9f4f288ed\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:39.026824 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:39.026733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:39.316311 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:39.316283    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"]
Sep 11 16:20:39.318455 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:20:39.318421    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2eb925_168c_43cb_a248_79b9f4f288ed.slice/crio-04c5995d5a0e8b7b132785d30fcc9a15d3de31ffa895cc447d93d28abccffd0f WatchSource:0}: Error finding container 04c5995d5a0e8b7b132785d30fcc9a15d3de31ffa895cc447d93d28abccffd0f: Status 404 returned error can't find the container with id 04c5995d5a0e8b7b132785d30fcc9a15d3de31ffa895cc447d93d28abccffd0f
Sep 11 16:20:40.204746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:40.204712    2557 generic.go:356] "Generic (PLEG): container finished" podID="5c2eb925-168c-43cb-a248-79b9f4f288ed" containerID="c30428322e97afeaa62848f40937575abd5711b8c1d61d7a173ec22c82c068a9" exitCode=0
Sep 11 16:20:40.205164 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:40.204799    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q" event={"ID":"5c2eb925-168c-43cb-a248-79b9f4f288ed","Type":"ContainerDied","Data":"c30428322e97afeaa62848f40937575abd5711b8c1d61d7a173ec22c82c068a9"}
Sep 11 16:20:40.205164 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:40.204857    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q" event={"ID":"5c2eb925-168c-43cb-a248-79b9f4f288ed","Type":"ContainerStarted","Data":"04c5995d5a0e8b7b132785d30fcc9a15d3de31ffa895cc447d93d28abccffd0f"}
Sep 11 16:20:41.347946 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:41.347921    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:41.410748 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:41.410716    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c2eb925-168c-43cb-a248-79b9f4f288ed-maas-api-service-ca\") pod \"5c2eb925-168c-43cb-a248-79b9f4f288ed\" (UID: \"5c2eb925-168c-43cb-a248-79b9f4f288ed\") "
Sep 11 16:20:41.411117 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:41.411082    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c2eb925-168c-43cb-a248-79b9f4f288ed-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c2eb925-168c-43cb-a248-79b9f4f288ed" (UID: "5c2eb925-168c-43cb-a248-79b9f4f288ed"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:41.511729 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:41.511647    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c2eb925-168c-43cb-a248-79b9f4f288ed-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:42.216753 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.216724    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"
Sep 11 16:20:42.216925 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.216775    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q" event={"ID":"5c2eb925-168c-43cb-a248-79b9f4f288ed","Type":"ContainerDied","Data":"04c5995d5a0e8b7b132785d30fcc9a15d3de31ffa895cc447d93d28abccffd0f"}
Sep 11 16:20:42.216925 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.216824    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04c5995d5a0e8b7b132785d30fcc9a15d3de31ffa895cc447d93d28abccffd0f"
Sep 11 16:20:42.498166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.498008    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"]
Sep 11 16:20:42.498604 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.498269    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" containerID="cri-o://db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d" gracePeriod=30
Sep 11 16:20:42.847788 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.847753    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"]
Sep 11 16:20:42.848205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.848191    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c2eb925-168c-43cb-a248-79b9f4f288ed" containerName="revoke-keys"
Sep 11 16:20:42.848260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.848207    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c2eb925-168c-43cb-a248-79b9f4f288ed" containerName="revoke-keys"
Sep 11 16:20:42.848294 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.848264    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c2eb925-168c-43cb-a248-79b9f4f288ed" containerName="revoke-keys"
Sep 11 16:20:42.851796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.851774    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:42.854800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.854550    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:20:42.854800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.854644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:20:42.862442 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.862412    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"]
Sep 11 16:20:42.925932 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:42.925896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff290a3-3531-4e3c-a502-70eb00310cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs\" (UID: \"2ff290a3-3531-4e3c-a502-70eb00310cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:43.029469 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:43.029418    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff290a3-3531-4e3c-a502-70eb00310cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs\" (UID: \"2ff290a3-3531-4e3c-a502-70eb00310cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:43.030410 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:43.030370    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff290a3-3531-4e3c-a502-70eb00310cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs\" (UID: \"2ff290a3-3531-4e3c-a502-70eb00310cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:43.162841 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:43.162733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:43.438584 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:43.438508    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"]
Sep 11 16:20:43.441057 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:20:43.441011    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff290a3_3531_4e3c_a502_70eb00310cf7.slice/crio-28bedc5296a14954857782203bc01f8c7d42163ebbad16761bd7be5961de116f WatchSource:0}: Error finding container 28bedc5296a14954857782203bc01f8c7d42163ebbad16761bd7be5961de116f: Status 404 returned error can't find the container with id 28bedc5296a14954857782203bc01f8c7d42163ebbad16761bd7be5961de116f
Sep 11 16:20:44.230926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:44.230890    2557 generic.go:356] "Generic (PLEG): container finished" podID="2ff290a3-3531-4e3c-a502-70eb00310cf7" containerID="7ada2dae6a2934da6aa12a38c298d9846efd88847194527ca2eab966f9e52d75" exitCode=0
Sep 11 16:20:44.231340 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:44.230979    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs" event={"ID":"2ff290a3-3531-4e3c-a502-70eb00310cf7","Type":"ContainerDied","Data":"7ada2dae6a2934da6aa12a38c298d9846efd88847194527ca2eab966f9e52d75"}
Sep 11 16:20:44.231340 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:44.231034    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs" event={"ID":"2ff290a3-3531-4e3c-a502-70eb00310cf7","Type":"ContainerStarted","Data":"28bedc5296a14954857782203bc01f8c7d42163ebbad16761bd7be5961de116f"}
Sep 11 16:20:44.517139 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:44.517036    2557 patch_prober.go:28] interesting pod/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:20:44.517139 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:44.517114    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:20:45.375921 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:45.375894    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:45.455222 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:45.455179    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff290a3-3531-4e3c-a502-70eb00310cf7-maas-api-service-ca\") pod \"2ff290a3-3531-4e3c-a502-70eb00310cf7\" (UID: \"2ff290a3-3531-4e3c-a502-70eb00310cf7\") "
Sep 11 16:20:45.455556 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:45.455532    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff290a3-3531-4e3c-a502-70eb00310cf7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ff290a3-3531-4e3c-a502-70eb00310cf7" (UID: "2ff290a3-3531-4e3c-a502-70eb00310cf7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:45.556913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:45.556868    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ff290a3-3531-4e3c-a502-70eb00310cf7-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:46.243976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:46.243930    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs" event={"ID":"2ff290a3-3531-4e3c-a502-70eb00310cf7","Type":"ContainerDied","Data":"28bedc5296a14954857782203bc01f8c7d42163ebbad16761bd7be5961de116f"}
Sep 11 16:20:46.244216 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:46.243998    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28bedc5296a14954857782203bc01f8c7d42163ebbad16761bd7be5961de116f"
Sep 11 16:20:46.244216 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:46.244111    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"
Sep 11 16:20:47.759437 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.759375    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:20:47.881124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881086    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-data\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881134    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-socket\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881386 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881157    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-envoy\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881386 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881174    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-certs\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881386 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881210    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-credential-socket\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881386 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881249    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx924\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-kube-api-access-jx924\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881386 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881289    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istiod-ca-cert\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881392    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-podinfo\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881433    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-token\") pod \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\" (UID: \"a37ffded-36ba-4ca3-bda0-5b101c5c7805\") "
Sep 11 16:20:47.881636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881454    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:47.881636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881479    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:47.881636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881464    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-data" (OuterVolumeSpecName: "istio-data") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:47.881636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881624    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:47.881905 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881781    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.881905 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881798    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.881905 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881812    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.881905 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881823    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.882221 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.881939    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:47.883536 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.883510    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:20:47.884071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.884023    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:20:47.884071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.884037    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-token" (OuterVolumeSpecName: "istio-token") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:47.884336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.884314    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-kube-api-access-jx924" (OuterVolumeSpecName: "kube-api-access-jx924") pod "a37ffded-36ba-4ca3-bda0-5b101c5c7805" (UID: "a37ffded-36ba-4ca3-bda0-5b101c5c7805"). InnerVolumeSpecName "kube-api-access-jx924". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:47.983191 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.983147    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.983191 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.983183    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx924\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-kube-api-access-jx924\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.983191 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.983195    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.983545 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.983207    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:47.983545 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:47.983217    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a37ffded-36ba-4ca3-bda0-5b101c5c7805-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:48.256466 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.256428    2557 generic.go:356] "Generic (PLEG): container finished" podID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerID="db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d" exitCode=0
Sep 11 16:20:48.256679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.256482    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"
Sep 11 16:20:48.256679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.256516    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" event={"ID":"a37ffded-36ba-4ca3-bda0-5b101c5c7805","Type":"ContainerDied","Data":"db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d"}
Sep 11 16:20:48.256679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.256585    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts" event={"ID":"a37ffded-36ba-4ca3-bda0-5b101c5c7805","Type":"ContainerDied","Data":"0db5c8313b8b8e1931bfc12ca8325e218ce430d2fd23128249c43b23636c7fdd"}
Sep 11 16:20:48.256679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.256616    2557 scope.go:117] "RemoveContainer" containerID="db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d"
Sep 11 16:20:48.269469 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.269447    2557 scope.go:117] "RemoveContainer" containerID="3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"
Sep 11 16:20:48.277968 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.277946    2557 scope.go:117] "RemoveContainer" containerID="db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d"
Sep 11 16:20:48.278276 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:20:48.278257    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d\": container with ID starting with db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d not found: ID does not exist" containerID="db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d"
Sep 11 16:20:48.278326 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.278286    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d"} err="failed to get container status \"db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d\": rpc error: code = NotFound desc = could not find container \"db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d\": container with ID starting with db1494ad09e80f0efff7633f1d97b52ee17467fa99cc47dcea677d06441f089d not found: ID does not exist"
Sep 11 16:20:48.278326 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.278304    2557 scope.go:117] "RemoveContainer" containerID="3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"
Sep 11 16:20:48.278579 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:20:48.278561    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e\": container with ID starting with 3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e not found: ID does not exist" containerID="3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"
Sep 11 16:20:48.278624 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.278586    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e"} err="failed to get container status \"3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e\": rpc error: code = NotFound desc = could not find container \"3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e\": container with ID starting with 3034848f34fbbb2dd593baadf95836c32cf7b61929f41110fb40ca8b83e38b9e not found: ID does not exist"
Sep 11 16:20:48.282958 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.282933    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"]
Sep 11 16:20:48.296310 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.296286    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-99877a-openshift-default-6d69888f8d-wlwts"]
Sep 11 16:20:48.893086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:48.893038    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" path="/var/lib/kubelet/pods/a37ffded-36ba-4ca3-bda0-5b101c5c7805/volumes"
Sep 11 16:20:53.138683 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.138651    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"]
Sep 11 16:20:53.139152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.138872    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf" podUID="8fc90803-66b7-4f04-9bf4-8e88410e1071" containerName="payload-processing" containerID="cri-o://b6c5948ab1f1905610ee3b2b069f617cd3a8871d87a3367fc0a22257541aae37" gracePeriod=30
Sep 11 16:20:53.286596 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.286559    2557 generic.go:356] "Generic (PLEG): container finished" podID="8fc90803-66b7-4f04-9bf4-8e88410e1071" containerID="b6c5948ab1f1905610ee3b2b069f617cd3a8871d87a3367fc0a22257541aae37" exitCode=0
Sep 11 16:20:53.286784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.286638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf" event={"ID":"8fc90803-66b7-4f04-9bf4-8e88410e1071","Type":"ContainerDied","Data":"b6c5948ab1f1905610ee3b2b069f617cd3a8871d87a3367fc0a22257541aae37"}
Sep 11 16:20:53.345562 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.345475    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"]
Sep 11 16:20:53.346195 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.345746    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl" podUID="a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" containerName="payload-processing" containerID="cri-o://df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0" gracePeriod=30
Sep 11 16:20:53.389935 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.389804    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"]
Sep 11 16:20:53.392880 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.392848    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b6b139-5ndxs"]
Sep 11 16:20:53.473754 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.473716    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:20:53.611136 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.611104    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:53.642297 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.642263    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2bp9\" (UniqueName: \"kubernetes.io/projected/8fc90803-66b7-4f04-9bf4-8e88410e1071-kube-api-access-c2bp9\") pod \"8fc90803-66b7-4f04-9bf4-8e88410e1071\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") "
Sep 11 16:20:53.642501 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.642347    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc90803-66b7-4f04-9bf4-8e88410e1071-plugins-config-volume\") pod \"8fc90803-66b7-4f04-9bf4-8e88410e1071\" (UID: \"8fc90803-66b7-4f04-9bf4-8e88410e1071\") "
Sep 11 16:20:53.642815 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.642749    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fc90803-66b7-4f04-9bf4-8e88410e1071-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8fc90803-66b7-4f04-9bf4-8e88410e1071" (UID: "8fc90803-66b7-4f04-9bf4-8e88410e1071"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:53.644922 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.644894    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fc90803-66b7-4f04-9bf4-8e88410e1071-kube-api-access-c2bp9" (OuterVolumeSpecName: "kube-api-access-c2bp9") pod "8fc90803-66b7-4f04-9bf4-8e88410e1071" (UID: "8fc90803-66b7-4f04-9bf4-8e88410e1071"). InnerVolumeSpecName "kube-api-access-c2bp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:53.723791 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.723752    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"]
Sep 11 16:20:53.727260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.727235    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3882e47c-wcd6q"]
Sep 11 16:20:53.743707 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.743680    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-plugins-config-volume\") pod \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") "
Sep 11 16:20:53.743851 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.743723    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5djwc\" (UniqueName: \"kubernetes.io/projected/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-kube-api-access-5djwc\") pod \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\" (UID: \"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9\") "
Sep 11 16:20:53.744020 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.744005    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2bp9\" (UniqueName: \"kubernetes.io/projected/8fc90803-66b7-4f04-9bf4-8e88410e1071-kube-api-access-c2bp9\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.744104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.744022    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8fc90803-66b7-4f04-9bf4-8e88410e1071-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.744153 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.744123    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" (UID: "a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:20:53.745792 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.745770    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-kube-api-access-5djwc" (OuterVolumeSpecName: "kube-api-access-5djwc") pod "a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" (UID: "a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9"). InnerVolumeSpecName "kube-api-access-5djwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:20:53.844923 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.844877    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:53.844923 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:53.844908    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5djwc\" (UniqueName: \"kubernetes.io/projected/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9-kube-api-access-5djwc\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:20:54.292748 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.292716    2557 generic.go:356] "Generic (PLEG): container finished" podID="a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" containerID="df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0" exitCode=0
Sep 11 16:20:54.293225 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.292766    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"
Sep 11 16:20:54.293225 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.292795    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl" event={"ID":"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9","Type":"ContainerDied","Data":"df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0"}
Sep 11 16:20:54.293225 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.292849    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl" event={"ID":"a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9","Type":"ContainerDied","Data":"51ab006e621e4db891378fd7d50f1adba4e573dc1319b458174e444de431c6e2"}
Sep 11 16:20:54.293225 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.292876    2557 scope.go:117] "RemoveContainer" containerID="df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0"
Sep 11 16:20:54.294284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.294184    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf" event={"ID":"8fc90803-66b7-4f04-9bf4-8e88410e1071","Type":"ContainerDied","Data":"37ce0da9a6bf993049b8f30b8ca5b5a803fbc757bd83372f8e00453a1d61b9ff"}
Sep 11 16:20:54.294284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.294192    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"
Sep 11 16:20:54.301698 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.301674    2557 scope.go:117] "RemoveContainer" containerID="df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0"
Sep 11 16:20:54.301965 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:20:54.301947    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0\": container with ID starting with df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0 not found: ID does not exist" containerID="df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0"
Sep 11 16:20:54.302024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.301971    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0"} err="failed to get container status \"df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0\": rpc error: code = NotFound desc = could not find container \"df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0\": container with ID starting with df8defeaed3ec044a6a809ef2d62e87460db6ebfb6ac9deb031d83d1dcb65cb0 not found: ID does not exist"
Sep 11 16:20:54.302024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.301987    2557 scope.go:117] "RemoveContainer" containerID="b6c5948ab1f1905610ee3b2b069f617cd3a8871d87a3367fc0a22257541aae37"
Sep 11 16:20:54.320024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.319994    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"]
Sep 11 16:20:54.324125 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.324100    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b6b139-74746dfc57-7xcrf"]
Sep 11 16:20:54.335500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.335465    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"]
Sep 11 16:20:54.339620 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.339590    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3882e47c-74cf8b7cdf-sllvl"]
Sep 11 16:20:54.892690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.892655    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff290a3-3531-4e3c-a502-70eb00310cf7" path="/var/lib/kubelet/pods/2ff290a3-3531-4e3c-a502-70eb00310cf7/volumes"
Sep 11 16:20:54.893116 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.893099    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c2eb925-168c-43cb-a248-79b9f4f288ed" path="/var/lib/kubelet/pods/5c2eb925-168c-43cb-a248-79b9f4f288ed/volumes"
Sep 11 16:20:54.893457 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.893433    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fc90803-66b7-4f04-9bf4-8e88410e1071" path="/var/lib/kubelet/pods/8fc90803-66b7-4f04-9bf4-8e88410e1071/volumes"
Sep 11 16:20:54.893765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:20:54.893752    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" path="/var/lib/kubelet/pods/a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9/volumes"
Sep 11 16:21:00.942359 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:00.942328    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"]
Sep 11 16:21:00.942790 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:00.942546    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy" containerID="cri-o://4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521" gracePeriod=30
Sep 11 16:21:01.863298 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863256    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"]
Sep 11 16:21:01.863748 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863730    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863750    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863768    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863775    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863792    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff290a3-3531-4e3c-a502-70eb00310cf7" containerName="revoke-keys"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863801    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff290a3-3531-4e3c-a502-70eb00310cf7" containerName="revoke-keys"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863815    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fc90803-66b7-4f04-9bf4-8e88410e1071" containerName="payload-processing"
Sep 11 16:21:01.863838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863822    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fc90803-66b7-4f04-9bf4-8e88410e1071" containerName="payload-processing"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863849    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" containerName="payload-processing"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863856    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" containerName="payload-processing"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863940    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81c9e9b-c34d-4ebd-aa9b-9335baaaadf9" containerName="payload-processing"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863958    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863968    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fc90803-66b7-4f04-9bf4-8e88410e1071" containerName="payload-processing"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863978    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a37ffded-36ba-4ca3-bda0-5b101c5c7805" containerName="istio-proxy"
Sep 11 16:21:01.864208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.863986    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff290a3-3531-4e3c-a502-70eb00310cf7" containerName="revoke-keys"
Sep 11 16:21:01.868576 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.868553    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.873934 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.873911    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-1ec6e6-openshift-default-dockercfg-88njp\""
Sep 11 16:21:01.904455 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.904419    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"]
Sep 11 16:21:01.923458 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-envoy\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923472    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-istio-token\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923535    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-credential-socket\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fb79636-a7d6-4343-8999-2287782a02ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923625 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923617    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fb79636-a7d6-4343-8999-2287782a02ea-istio-podinfo\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923770 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tbtn\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-kube-api-access-5tbtn\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-certs\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.923975 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.923915    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-data\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:01.924024 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:01.924004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-socket\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025154 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-socket\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-envoy\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025277    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-istio-token\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-credential-socket\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025370    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fb79636-a7d6-4343-8999-2287782a02ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fb79636-a7d6-4343-8999-2287782a02ea-istio-podinfo\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025436    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tbtn\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-kube-api-access-5tbtn\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025506    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-certs\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.025570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025531    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-data\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.026059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-credential-socket\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.026059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025821    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-certs\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.026059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025864    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-data\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.026059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.025906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-socket\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.026387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.026357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fb79636-a7d6-4343-8999-2287782a02ea-istiod-ca-cert\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.027629 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.027604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-envoy\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.027729 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.027697    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fb79636-a7d6-4343-8999-2287782a02ea-istio-podinfo\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.051434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.051400    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-istio-token\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.051844 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.051825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tbtn\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-kube-api-access-5tbtn\") pod \"e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") " pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.178872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.178774    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:02.458635 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.458608    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"]
Sep 11 16:21:02.460408 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:21:02.460381    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb79636_a7d6_4343_8999_2287782a02ea.slice/crio-e764cec955a149de54723b1b115fb23088c060bdade09ff39e340e85f3da76da WatchSource:0}: Error finding container e764cec955a149de54723b1b115fb23088c060bdade09ff39e340e85f3da76da: Status 404 returned error can't find the container with id e764cec955a149de54723b1b115fb23088c060bdade09ff39e340e85f3da76da
Sep 11 16:21:02.462505 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.462475    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:02.462581 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.462537    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:02.462623 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:02.462582    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:03.350128 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:03.350085    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" event={"ID":"6fb79636-a7d6-4343-8999-2287782a02ea","Type":"ContainerStarted","Data":"f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"}
Sep 11 16:21:03.350616 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:03.350152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" event={"ID":"6fb79636-a7d6-4343-8999-2287782a02ea","Type":"ContainerStarted","Data":"e764cec955a149de54723b1b115fb23088c060bdade09ff39e340e85f3da76da"}
Sep 11 16:21:03.392842 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:03.392786    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podStartSLOduration=2.392771017 podStartE2EDuration="2.392771017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:03.392399395 +0000 UTC m=+1126.942587248" watchObservedRunningTime="2026-09-11 16:21:03.392771017 +0000 UTC m=+1126.942958870"
Sep 11 16:21:04.180005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:04.179962    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:04.185071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:04.185021    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:04.357358 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:04.357324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:04.358428 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:04.358404    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:06.184793 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.184764    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:21:06.267014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.266922    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb79dda0-ff65-48f1-b5bd-c03c28456665-istiod-ca-cert\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.266966    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-podinfo\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267008    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js9l8\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-kube-api-access-js9l8\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267112    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-certs\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267157    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-credential-socket\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267217    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-data\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267290 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267274    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-token\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267336    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-envoy\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267366    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-socket\") pod \"cb79dda0-ff65-48f1-b5bd-c03c28456665\" (UID: \"cb79dda0-ff65-48f1-b5bd-c03c28456665\") "
Sep 11 16:21:06.267491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267449    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:06.267491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267465    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb79dda0-ff65-48f1-b5bd-c03c28456665-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:21:06.267491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267465    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:06.267491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267486    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:06.267840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267676    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:06.267840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267786    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.267840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267805    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb79dda0-ff65-48f1-b5bd-c03c28456665-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.267840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267814    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.267840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267826    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.267840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.267838    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.269351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.269323    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-kube-api-access-js9l8" (OuterVolumeSpecName: "kube-api-access-js9l8") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "kube-api-access-js9l8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:21:06.269505 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.269487    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:21:06.269784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.269756    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:21:06.269911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.269811    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb79dda0-ff65-48f1-b5bd-c03c28456665" (UID: "cb79dda0-ff65-48f1-b5bd-c03c28456665"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:21:06.368413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.368374    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.368413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.368407    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.368413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.368416    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js9l8\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-kube-api-access-js9l8\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.368413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.368424    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb79dda0-ff65-48f1-b5bd-c03c28456665-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:21:06.378015 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.377976    2557 generic.go:356] "Generic (PLEG): container finished" podID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerID="4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521" exitCode=0
Sep 11 16:21:06.378205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.378030    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"
Sep 11 16:21:06.378205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.378077    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" event={"ID":"cb79dda0-ff65-48f1-b5bd-c03c28456665","Type":"ContainerDied","Data":"4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521"}
Sep 11 16:21:06.378205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.378175    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr" event={"ID":"cb79dda0-ff65-48f1-b5bd-c03c28456665","Type":"ContainerDied","Data":"85d3445f05c3d2fb15c3f95f5043e955475be106d0486b0ab4e3be4730b6fb8f"}
Sep 11 16:21:06.378205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.378200    2557 scope.go:117] "RemoveContainer" containerID="4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521"
Sep 11 16:21:06.387891 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.387870    2557 scope.go:117] "RemoveContainer" containerID="8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"
Sep 11 16:21:06.396059 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.396022    2557 scope.go:117] "RemoveContainer" containerID="4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521"
Sep 11 16:21:06.396354 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:21:06.396335    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521\": container with ID starting with 4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521 not found: ID does not exist" containerID="4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521"
Sep 11 16:21:06.396403 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.396364    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521"} err="failed to get container status \"4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521\": rpc error: code = NotFound desc = could not find container \"4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521\": container with ID starting with 4736bbf43ecdfbb9e19eb92b0888104c8a165512afea2e3ce7dc3a6d4bcee521 not found: ID does not exist"
Sep 11 16:21:06.396403 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.396383    2557 scope.go:117] "RemoveContainer" containerID="8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"
Sep 11 16:21:06.396640 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:21:06.396624    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85\": container with ID starting with 8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85 not found: ID does not exist" containerID="8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"
Sep 11 16:21:06.396691 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.396641    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85"} err="failed to get container status \"8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85\": rpc error: code = NotFound desc = could not find container \"8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85\": container with ID starting with 8298e46e0f615ccd7b068fbb77bb56c54f01220ea3b515783265c9619710da85 not found: ID does not exist"
Sep 11 16:21:06.405403 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.405378    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"]
Sep 11 16:21:06.411928 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.411903    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-b6b139-openshift-default-797f5b6cc8-w8gqr"]
Sep 11 16:21:06.892775 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:06.892741    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" path="/var/lib/kubelet/pods/cb79dda0-ff65-48f1-b5bd-c03c28456665/volumes"
Sep 11 16:21:20.398260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:20.398210    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 16:21:20.400580 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:20.398295    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:21:21.458922 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:21.458822    2557 generic.go:356] "Generic (PLEG): container finished" podID="6fb79636-a7d6-4343-8999-2287782a02ea" containerID="f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c" exitCode=0
Sep 11 16:21:21.458922 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:21.458882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" event={"ID":"6fb79636-a7d6-4343-8999-2287782a02ea","Type":"ContainerDied","Data":"f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"}
Sep 11 16:21:21.459401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:21.459287    2557 scope.go:117] "RemoveContainer" containerID="f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"
Sep 11 16:21:21.460415 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:21.460381    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:21.460478 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:21.460460    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:21.460524 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:21.460496    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:22.474455 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:22.474407    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" event={"ID":"6fb79636-a7d6-4343-8999-2287782a02ea","Type":"ContainerStarted","Data":"72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518"}
Sep 11 16:21:23.179262 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:23.179209    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:23.179473 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:23.179450    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 11 16:21:23.179522 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:23.179503    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 11 16:21:24.179577 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:24.179537    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 11 16:21:24.180071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:24.179600    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 11 16:21:25.180128 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:25.180091    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 11 16:21:25.180488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:25.180160    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 11 16:21:26.179238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:26.179200    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 11 16:21:26.179416 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:26.179261    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 11 16:21:27.179343 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:27.179303    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 11 16:21:27.179745 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:27.179366    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 11 16:21:28.183911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:28.183877    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:28.184327 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:28.184310    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:28.185180 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:28.185158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:21:29.546353 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.546315    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"]
Sep 11 16:21:29.546835 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.546818    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy"
Sep 11 16:21:29.546898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.546837    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy"
Sep 11 16:21:29.546898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.546850    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy"
Sep 11 16:21:29.546898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.546859    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy"
Sep 11 16:21:29.547003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.546967    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy"
Sep 11 16:21:29.550702 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.550678    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.555302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.555278    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-3db535\""
Sep 11 16:21:29.573728 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.573691    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"]
Sep 11 16:21:29.611084 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.611037    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"]
Sep 11 16:21:29.611501 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.611488    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb79dda0-ff65-48f1-b5bd-c03c28456665" containerName="istio-proxy"
Sep 11 16:21:29.614435 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.614416    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.621818 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.621798    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-3db535-dockercfg-f6gtz\""
Sep 11 16:21:29.641796 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.641766    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"]
Sep 11 16:21:29.711567 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.711526    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzl2\" (UniqueName: \"kubernetes.io/projected/71335103-08f0-4e5b-9051-69b0e17fa4fd-kube-api-access-kmzl2\") pod \"payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.711746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.711643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71335103-08f0-4e5b-9051-69b0e17fa4fd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.711746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.711709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f4312b2-9576-4e44-bac5-131079d25e04-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.711828 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.711783    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7bh6\" (UniqueName: \"kubernetes.io/projected/2f4312b2-9576-4e44-bac5-131079d25e04-kube-api-access-l7bh6\") pod \"payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.812763 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.812670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71335103-08f0-4e5b-9051-69b0e17fa4fd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.812934 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.812815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f4312b2-9576-4e44-bac5-131079d25e04-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.812934 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.812851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bh6\" (UniqueName: \"kubernetes.io/projected/2f4312b2-9576-4e44-bac5-131079d25e04-kube-api-access-l7bh6\") pod \"payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.812934 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.812880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzl2\" (UniqueName: \"kubernetes.io/projected/71335103-08f0-4e5b-9051-69b0e17fa4fd-kube-api-access-kmzl2\") pod \"payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.813414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.813394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71335103-08f0-4e5b-9051-69b0e17fa4fd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.813521 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.813503    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f4312b2-9576-4e44-bac5-131079d25e04-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.826566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.826533    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7bh6\" (UniqueName: \"kubernetes.io/projected/2f4312b2-9576-4e44-bac5-131079d25e04-kube-api-access-l7bh6\") pod \"payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.841412 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.841384    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzl2\" (UniqueName: \"kubernetes.io/projected/71335103-08f0-4e5b-9051-69b0e17fa4fd-kube-api-access-kmzl2\") pod \"payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:29.860229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.860194    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:29.925327 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:29.925064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:30.159210 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.159181    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"]
Sep 11 16:21:30.160768 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:21:30.160740    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4312b2_9576_4e44_bac5_131079d25e04.slice/crio-c086effd99e409088a5c556e3e663ec87140221bf8d136c60ee14c5e990b5b1f WatchSource:0}: Error finding container c086effd99e409088a5c556e3e663ec87140221bf8d136c60ee14c5e990b5b1f: Status 404 returned error can't find the container with id c086effd99e409088a5c556e3e663ec87140221bf8d136c60ee14c5e990b5b1f
Sep 11 16:21:30.224036 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.223876    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"]
Sep 11 16:21:30.225980 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:21:30.225952    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71335103_08f0_4e5b_9051_69b0e17fa4fd.slice/crio-e5af25d90889ae3a6958c005a13fd03d823969b71dc8b826219c7e1ec3bfbb77 WatchSource:0}: Error finding container e5af25d90889ae3a6958c005a13fd03d823969b71dc8b826219c7e1ec3bfbb77: Status 404 returned error can't find the container with id e5af25d90889ae3a6958c005a13fd03d823969b71dc8b826219c7e1ec3bfbb77
Sep 11 16:21:30.515237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.515138    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r" event={"ID":"71335103-08f0-4e5b-9051-69b0e17fa4fd","Type":"ContainerStarted","Data":"d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2"}
Sep 11 16:21:30.515416 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.515310    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:30.515416 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.515351    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r" event={"ID":"71335103-08f0-4e5b-9051-69b0e17fa4fd","Type":"ContainerStarted","Data":"e5af25d90889ae3a6958c005a13fd03d823969b71dc8b826219c7e1ec3bfbb77"}
Sep 11 16:21:30.516821 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.516796    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx" event={"ID":"2f4312b2-9576-4e44-bac5-131079d25e04","Type":"ContainerStarted","Data":"74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374"}
Sep 11 16:21:30.516926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.516842    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx" event={"ID":"2f4312b2-9576-4e44-bac5-131079d25e04","Type":"ContainerStarted","Data":"c086effd99e409088a5c556e3e663ec87140221bf8d136c60ee14c5e990b5b1f"}
Sep 11 16:21:30.516926 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.516874    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:30.552076 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.552001    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r" podStartSLOduration=1.551985124 podStartE2EDuration="1.551985124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:30.550294079 +0000 UTC m=+1154.100481932" watchObservedRunningTime="2026-09-11 16:21:30.551985124 +0000 UTC m=+1154.102172977"
Sep 11 16:21:30.595369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:30.595308    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx" podStartSLOduration=1.5952908479999999 podStartE2EDuration="1.595290848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:30.593139261 +0000 UTC m=+1154.143327113" watchObservedRunningTime="2026-09-11 16:21:30.595290848 +0000 UTC m=+1154.145478700"
Sep 11 16:21:38.685675 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.685636    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"]
Sep 11 16:21:38.690309 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.690291    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:38.693441 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.693420    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-233d22-dockercfg-dvcl4\""
Sep 11 16:21:38.693675 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.693653    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-233d22\""
Sep 11 16:21:38.712075 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.709910    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"]
Sep 11 16:21:38.803638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.803594    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwl87\" (UniqueName: \"kubernetes.io/projected/a4dc2def-faef-425d-a7b5-06bfa2ae162b-kube-api-access-dwl87\") pod \"payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:38.803819 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.803656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4dc2def-faef-425d-a7b5-06bfa2ae162b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:38.904562 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.904522    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwl87\" (UniqueName: \"kubernetes.io/projected/a4dc2def-faef-425d-a7b5-06bfa2ae162b-kube-api-access-dwl87\") pod \"payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:38.904740 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.904572    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4dc2def-faef-425d-a7b5-06bfa2ae162b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:38.905274 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.905255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4dc2def-faef-425d-a7b5-06bfa2ae162b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:38.920060 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:38.920021    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwl87\" (UniqueName: \"kubernetes.io/projected/a4dc2def-faef-425d-a7b5-06bfa2ae162b-kube-api-access-dwl87\") pod \"payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:39.001404 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:39.001312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:39.280336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:39.280303    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"]
Sep 11 16:21:39.283035 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:21:39.283006    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4dc2def_faef_425d_a7b5_06bfa2ae162b.slice/crio-d169ad8c8a120068d73ad71c5cf9878331f3fc63989e147819d34a7465c540ab WatchSource:0}: Error finding container d169ad8c8a120068d73ad71c5cf9878331f3fc63989e147819d34a7465c540ab: Status 404 returned error can't find the container with id d169ad8c8a120068d73ad71c5cf9878331f3fc63989e147819d34a7465c540ab
Sep 11 16:21:39.566814 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:39.566771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" event={"ID":"a4dc2def-faef-425d-a7b5-06bfa2ae162b","Type":"ContainerStarted","Data":"26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7"}
Sep 11 16:21:39.567001 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:39.566844    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:21:39.567001 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:39.566866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" event={"ID":"a4dc2def-faef-425d-a7b5-06bfa2ae162b","Type":"ContainerStarted","Data":"d169ad8c8a120068d73ad71c5cf9878331f3fc63989e147819d34a7465c540ab"}
Sep 11 16:21:39.615446 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:39.615393    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" podStartSLOduration=1.615374864 podStartE2EDuration="1.615374864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:39.614722066 +0000 UTC m=+1163.164909919" watchObservedRunningTime="2026-09-11 16:21:39.615374864 +0000 UTC m=+1163.165562718"
Sep 11 16:21:40.435127 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.435092    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"]
Sep 11 16:21:40.439008 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.438981    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.445862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.445616    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-7ce5d6-openshift-default-dockercfg-x5llp\""
Sep 11 16:21:40.520272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-certs\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520293    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-token\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520352    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63de9db0-3fc3-4310-b50c-09d84d00071b-istiod-ca-cert\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520379    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-socket\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520432    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-credential-socket\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cmh\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-kube-api-access-24cmh\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520496    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-data\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520832 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-envoy\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.520832 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.520659    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-podinfo\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.587874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.587839    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"]
Sep 11 16:21:40.621564 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-certs\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621564 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-token\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63de9db0-3fc3-4310-b50c-09d84d00071b-istiod-ca-cert\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-socket\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621827 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621811    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-credential-socket\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621982 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cmh\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-kube-api-access-24cmh\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621982 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621910    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-data\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.621982 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.621960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-envoy\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.622150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.622023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-certs\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.622150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.622040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-podinfo\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.622251 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.622223    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-credential-socket\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.622468 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.622437    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63de9db0-3fc3-4310-b50c-09d84d00071b-istiod-ca-cert\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.622468 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.622449    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-data\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.623520 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.622565    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-socket\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.624685 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.624660    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-envoy\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.625011 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.624991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-podinfo\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.643157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.643122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cmh\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-kube-api-access-24cmh\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.647547 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.647516    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-token\") pod \"e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") " pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:40.750568 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:40.750483    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:41.077147 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.077022    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"]
Sep 11 16:21:41.077466 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:21:41.077439    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63de9db0_3fc3_4310_b50c_09d84d00071b.slice/crio-978539b9053fe91470940dc3dd172d423482e5b81a975037f2d54dcd15660555 WatchSource:0}: Error finding container 978539b9053fe91470940dc3dd172d423482e5b81a975037f2d54dcd15660555: Status 404 returned error can't find the container with id 978539b9053fe91470940dc3dd172d423482e5b81a975037f2d54dcd15660555
Sep 11 16:21:41.079885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.079851    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:41.079948 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.079926    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:41.079987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.079959    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:21:41.525237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.525149    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:21:41.525237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.525223    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:21:41.580360 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.580321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" event={"ID":"63de9db0-3fc3-4310-b50c-09d84d00071b","Type":"ContainerStarted","Data":"f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"}
Sep 11 16:21:41.580561 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.580391    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" event={"ID":"63de9db0-3fc3-4310-b50c-09d84d00071b","Type":"ContainerStarted","Data":"978539b9053fe91470940dc3dd172d423482e5b81a975037f2d54dcd15660555"}
Sep 11 16:21:41.635973 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.635887    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podStartSLOduration=1.635869044 podStartE2EDuration="1.635869044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:21:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:21:41.633375452 +0000 UTC m=+1165.183563323" watchObservedRunningTime="2026-09-11 16:21:41.635869044 +0000 UTC m=+1165.186056896"
Sep 11 16:21:41.751001 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:41.750963    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:42.756996 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:42.756964    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:43.591261 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:43.591181    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:43.592345 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:43.592329    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:21:50.574150 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:21:50.574115    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:22:04.715361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:04.715321    2557 generic.go:356] "Generic (PLEG): container finished" podID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerID="f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d" exitCode=0
Sep 11 16:22:04.715916 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:04.715396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" event={"ID":"63de9db0-3fc3-4310-b50c-09d84d00071b","Type":"ContainerDied","Data":"f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"}
Sep 11 16:22:04.716023 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:04.715926    2557 scope.go:117] "RemoveContainer" containerID="f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"
Sep 11 16:22:04.717140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:04.717114    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:04.717214 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:04.717182    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:04.717250 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:04.717213    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:05.722522 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:05.722487    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" event={"ID":"63de9db0-3fc3-4310-b50c-09d84d00071b","Type":"ContainerStarted","Data":"edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245"}
Sep 11 16:22:05.751068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:05.750995    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:22:05.751068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:05.751025    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 16:22:05.751336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:05.751085    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 16:22:06.751314 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:06.751270    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 16:22:06.751935 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:06.751898    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 16:22:07.751902 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:07.751862    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 16:22:07.752524 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:07.752475    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 16:22:08.751263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:08.751227    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 16:22:08.751570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:08.751538    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 16:22:09.750945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:09.750905    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 16:22:09.751446 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:09.750978    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 16:22:10.752018 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:10.751983    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 11 16:22:10.752635 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:10.752601    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 11 16:22:11.755181 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:11.755143    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:22:11.755599 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:11.755518    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:22:11.756279 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:11.756258    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:22:16.879010 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:16.878981    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:22:16.881080 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:16.880979    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:22:17.611997 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.611958    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"]
Sep 11 16:22:17.615362 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.615339    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.618110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.618085    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0a17a0fd-openshift-default-dockercfg-64998\""
Sep 11 16:22:17.628098 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.628021    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"]
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.699941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-certs\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700018    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-podinfo\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700083    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-credential-socket\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700138    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlsb\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-kube-api-access-htlsb\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-socket\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istiod-ca-cert\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-envoy\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-token\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.701112 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.700334    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-data\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801490 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlsb\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-kube-api-access-htlsb\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801490 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801496    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-socket\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801734 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801624    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istiod-ca-cert\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801734 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801690    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-envoy\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-token\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-data\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-certs\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.801845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801827    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-socket\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.802082 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801894    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-podinfo\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.802082 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.801951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-credential-socket\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.802202 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.802155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-data\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.802289 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.802273    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-certs\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.802364 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.802316    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-credential-socket\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.802492 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.802472    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istiod-ca-cert\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.803843 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.803825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-envoy\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.804164 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.804145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-podinfo\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.810154 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.810122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-token\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.810267 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.810131    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlsb\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-kube-api-access-htlsb\") pod \"e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") " pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:17.925478 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:17.925388    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:18.204432 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.204410    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"]
Sep 11 16:22:18.207034 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:22:18.206992    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8472b9_51ef_4583_b6cf_0b809af5f11f.slice/crio-3c32a6a2170506dc9b0b8008dc2241de9307ccdea2bd094c20e3c0a423b556db WatchSource:0}: Error finding container 3c32a6a2170506dc9b0b8008dc2241de9307ccdea2bd094c20e3c0a423b556db: Status 404 returned error can't find the container with id 3c32a6a2170506dc9b0b8008dc2241de9307ccdea2bd094c20e3c0a423b556db
Sep 11 16:22:18.209439 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.209402    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:18.209521 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.209476    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:18.209571 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.209517    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:18.795667 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.795634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" event={"ID":"2b8472b9-51ef-4583-b6cf-0b809af5f11f","Type":"ContainerStarted","Data":"31dfb6f17bf3b4ebac4a9e1c1ee18cd0e35aca47db951b5611e4e17296c0e202"}
Sep 11 16:22:18.795879 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.795683    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" event={"ID":"2b8472b9-51ef-4583-b6cf-0b809af5f11f","Type":"ContainerStarted","Data":"3c32a6a2170506dc9b0b8008dc2241de9307ccdea2bd094c20e3c0a423b556db"}
Sep 11 16:22:18.818889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.818833    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podStartSLOduration=1.818815899 podStartE2EDuration="1.818815899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:18.81703263 +0000 UTC m=+1202.367220486" watchObservedRunningTime="2026-09-11 16:22:18.818815899 +0000 UTC m=+1202.369003750"
Sep 11 16:22:18.925477 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:18.925443    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:19.931904 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:19.931875    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:20.806727 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:20.806692    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:20.807837 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:20.807814    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:25.136064 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.136011    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"]
Sep 11 16:22:25.140596 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.140569    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.144888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.144859    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0a17a0fd\""
Sep 11 16:22:25.145356 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.145059    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0a17a0fd-dockercfg-v2mhv\""
Sep 11 16:22:25.156712 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.156679    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"]
Sep 11 16:22:25.274940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.274901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg4ml\" (UniqueName: \"kubernetes.io/projected/2bb6a81b-3444-4458-9fe5-eecc036d7225-kube-api-access-gg4ml\") pod \"payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.275114 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.274969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb6a81b-3444-4458-9fe5-eecc036d7225-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.375690 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.375651    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg4ml\" (UniqueName: \"kubernetes.io/projected/2bb6a81b-3444-4458-9fe5-eecc036d7225-kube-api-access-gg4ml\") pod \"payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.375863 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.375702    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb6a81b-3444-4458-9fe5-eecc036d7225-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.376405 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.376386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb6a81b-3444-4458-9fe5-eecc036d7225-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.385283 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.385253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg4ml\" (UniqueName: \"kubernetes.io/projected/2bb6a81b-3444-4458-9fe5-eecc036d7225-kube-api-access-gg4ml\") pod \"payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.462357 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.462256    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.737004 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.736979    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"]
Sep 11 16:22:25.739084 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:22:25.739038    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb6a81b_3444_4458_9fe5_eecc036d7225.slice/crio-3d0487d56f78f73d85bf377e050a82412f7249464b9321106701024730bf0a8a WatchSource:0}: Error finding container 3d0487d56f78f73d85bf377e050a82412f7249464b9321106701024730bf0a8a: Status 404 returned error can't find the container with id 3d0487d56f78f73d85bf377e050a82412f7249464b9321106701024730bf0a8a
Sep 11 16:22:25.833416 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.833377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt" event={"ID":"2bb6a81b-3444-4458-9fe5-eecc036d7225","Type":"ContainerStarted","Data":"7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601"}
Sep 11 16:22:25.833613 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.833434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt" event={"ID":"2bb6a81b-3444-4458-9fe5-eecc036d7225","Type":"ContainerStarted","Data":"3d0487d56f78f73d85bf377e050a82412f7249464b9321106701024730bf0a8a"}
Sep 11 16:22:25.833676 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.833607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:25.853804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:25.853749    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt" podStartSLOduration=0.853733103 podStartE2EDuration="853.733103ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:22:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:22:25.851564386 +0000 UTC m=+1209.401752242" watchObservedRunningTime="2026-09-11 16:22:25.853733103 +0000 UTC m=+1209.403920999"
Sep 11 16:22:36.843691 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:36.843663    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:22:39.920259 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:39.920225    2557 generic.go:356] "Generic (PLEG): container finished" podID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerID="31dfb6f17bf3b4ebac4a9e1c1ee18cd0e35aca47db951b5611e4e17296c0e202" exitCode=0
Sep 11 16:22:39.920661 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:39.920299    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" event={"ID":"2b8472b9-51ef-4583-b6cf-0b809af5f11f","Type":"ContainerDied","Data":"31dfb6f17bf3b4ebac4a9e1c1ee18cd0e35aca47db951b5611e4e17296c0e202"}
Sep 11 16:22:39.920730 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:39.920715    2557 scope.go:117] "RemoveContainer" containerID="31dfb6f17bf3b4ebac4a9e1c1ee18cd0e35aca47db951b5611e4e17296c0e202"
Sep 11 16:22:39.921998 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:39.921971    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:39.922065 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:39.922055    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:39.922110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:39.922090    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:22:40.927648 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:40.927609    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" event={"ID":"2b8472b9-51ef-4583-b6cf-0b809af5f11f","Type":"ContainerStarted","Data":"f915ded991b57d6ddac386d218a1d2d4cdcfd42f3aa8c858aeebe1afa96f26fc"}
Sep 11 16:22:41.926261 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:41.926225    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:41.926527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:41.926494    2557 patch_prober.go:28] interesting pod/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:22:41.926574 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:41.926553    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 16:22:42.926134 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:42.926096    2557 patch_prober.go:28] interesting pod/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:22:42.926518 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:42.926150    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 16:22:43.925725 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:43.925689    2557 patch_prober.go:28] interesting pod/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:22:43.925908 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:43.925744    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 16:22:44.926570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:44.926534    2557 patch_prober.go:28] interesting pod/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:22:44.926961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:44.926588    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 16:22:45.925886 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:45.925854    2557 patch_prober.go:28] interesting pod/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Sep 11 16:22:45.926129 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:45.925910    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Sep 11 16:22:47.056741 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:47.056711    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:47.057246 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:47.057072    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:22:47.058115 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:22:47.058095    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:23:16.943316 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:16.943251    2557 scope.go:117] "RemoveContainer" containerID="03714aa59571e40af12e0de0ed53752fa8b919f6cf6e7ea02f8ff4bf00343f5f"
Sep 11 16:23:45.841018 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:45.840980    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"]
Sep 11 16:23:45.846388 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:45.846365    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:45.849621 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:45.849597    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:23:45.849907 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:45.849888    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:23:45.851572 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:45.851547    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"]
Sep 11 16:23:45.990292 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:45.990258    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a37fb26-e203-4c47-826f-16fa55099c63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz\" (UID: \"8a37fb26-e203-4c47-826f-16fa55099c63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:46.091711 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:46.091638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a37fb26-e203-4c47-826f-16fa55099c63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz\" (UID: \"8a37fb26-e203-4c47-826f-16fa55099c63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:46.092241 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:46.092222    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a37fb26-e203-4c47-826f-16fa55099c63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz\" (UID: \"8a37fb26-e203-4c47-826f-16fa55099c63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:46.160642 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:46.160610    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:46.429480 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:46.429455    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"]
Sep 11 16:23:46.431211 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:23:46.431182    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a37fb26_e203_4c47_826f_16fa55099c63.slice/crio-151c540ba0e3ad8a1358ca4320b5009abf104a3389f5334e0d948de0655976f4 WatchSource:0}: Error finding container 151c540ba0e3ad8a1358ca4320b5009abf104a3389f5334e0d948de0655976f4: Status 404 returned error can't find the container with id 151c540ba0e3ad8a1358ca4320b5009abf104a3389f5334e0d948de0655976f4
Sep 11 16:23:47.286531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:47.286492    2557 generic.go:356] "Generic (PLEG): container finished" podID="8a37fb26-e203-4c47-826f-16fa55099c63" containerID="0c9a056734d15ec616d59b4d3bfe7f59394aa42bc3c399500edd8a7f28913d14" exitCode=0
Sep 11 16:23:47.286898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:47.286574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz" event={"ID":"8a37fb26-e203-4c47-826f-16fa55099c63","Type":"ContainerDied","Data":"0c9a056734d15ec616d59b4d3bfe7f59394aa42bc3c399500edd8a7f28913d14"}
Sep 11 16:23:47.286898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:47.286629    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz" event={"ID":"8a37fb26-e203-4c47-826f-16fa55099c63","Type":"ContainerStarted","Data":"151c540ba0e3ad8a1358ca4320b5009abf104a3389f5334e0d948de0655976f4"}
Sep 11 16:23:48.429449 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:48.429427    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:48.617107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:48.617080    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a37fb26-e203-4c47-826f-16fa55099c63-maas-api-service-ca\") pod \"8a37fb26-e203-4c47-826f-16fa55099c63\" (UID: \"8a37fb26-e203-4c47-826f-16fa55099c63\") "
Sep 11 16:23:48.617465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:48.617442    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a37fb26-e203-4c47-826f-16fa55099c63-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a37fb26-e203-4c47-826f-16fa55099c63" (UID: "8a37fb26-e203-4c47-826f-16fa55099c63"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:23:48.718320 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:48.718282    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a37fb26-e203-4c47-826f-16fa55099c63-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:23:49.301111 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:49.301081    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"
Sep 11 16:23:49.301111 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:49.301102    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz" event={"ID":"8a37fb26-e203-4c47-826f-16fa55099c63","Type":"ContainerDied","Data":"151c540ba0e3ad8a1358ca4320b5009abf104a3389f5334e0d948de0655976f4"}
Sep 11 16:23:49.301303 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:23:49.301149    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="151c540ba0e3ad8a1358ca4320b5009abf104a3389f5334e0d948de0655976f4"
Sep 11 16:24:01.652944 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.652912    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"]
Sep 11 16:24:01.653297 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.653158    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt" podUID="2bb6a81b-3444-4458-9fe5-eecc036d7225" containerName="payload-pre-processing" containerID="cri-o://7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601" gracePeriod=30
Sep 11 16:24:01.911984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.911913    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:24:01.925809 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.925782    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"]
Sep 11 16:24:01.930895 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.930865    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0a17a0fd-p67qz"]
Sep 11 16:24:01.941140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.941116    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb6a81b-3444-4458-9fe5-eecc036d7225-plugins-config-volume\") pod \"2bb6a81b-3444-4458-9fe5-eecc036d7225\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") "
Sep 11 16:24:01.941331 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.941308    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg4ml\" (UniqueName: \"kubernetes.io/projected/2bb6a81b-3444-4458-9fe5-eecc036d7225-kube-api-access-gg4ml\") pod \"2bb6a81b-3444-4458-9fe5-eecc036d7225\" (UID: \"2bb6a81b-3444-4458-9fe5-eecc036d7225\") "
Sep 11 16:24:01.941511 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.941486    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bb6a81b-3444-4458-9fe5-eecc036d7225-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bb6a81b-3444-4458-9fe5-eecc036d7225" (UID: "2bb6a81b-3444-4458-9fe5-eecc036d7225"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:24:01.941741 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.941722    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bb6a81b-3444-4458-9fe5-eecc036d7225-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:24:01.943408 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:01.943379    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bb6a81b-3444-4458-9fe5-eecc036d7225-kube-api-access-gg4ml" (OuterVolumeSpecName: "kube-api-access-gg4ml") pod "2bb6a81b-3444-4458-9fe5-eecc036d7225" (UID: "2bb6a81b-3444-4458-9fe5-eecc036d7225"). InnerVolumeSpecName "kube-api-access-gg4ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:24:02.042552 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.042515    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg4ml\" (UniqueName: \"kubernetes.io/projected/2bb6a81b-3444-4458-9fe5-eecc036d7225-kube-api-access-gg4ml\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:24:02.379525 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.379486    2557 generic.go:356] "Generic (PLEG): container finished" podID="2bb6a81b-3444-4458-9fe5-eecc036d7225" containerID="7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601" exitCode=0
Sep 11 16:24:02.379705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.379534    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"
Sep 11 16:24:02.379705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.379568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt" event={"ID":"2bb6a81b-3444-4458-9fe5-eecc036d7225","Type":"ContainerDied","Data":"7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601"}
Sep 11 16:24:02.379705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.379618    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt" event={"ID":"2bb6a81b-3444-4458-9fe5-eecc036d7225","Type":"ContainerDied","Data":"3d0487d56f78f73d85bf377e050a82412f7249464b9321106701024730bf0a8a"}
Sep 11 16:24:02.379705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.379639    2557 scope.go:117] "RemoveContainer" containerID="7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601"
Sep 11 16:24:02.389840 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.389823    2557 scope.go:117] "RemoveContainer" containerID="7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601"
Sep 11 16:24:02.390121 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:24:02.390105    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601\": container with ID starting with 7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601 not found: ID does not exist" containerID="7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601"
Sep 11 16:24:02.390178 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.390128    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601"} err="failed to get container status \"7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601\": rpc error: code = NotFound desc = could not find container \"7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601\": container with ID starting with 7fce2de3b4dc7a83f97a19df4957cff086c17ac3f2ffce3b946a6b7831375601 not found: ID does not exist"
Sep 11 16:24:02.406429 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.406397    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"]
Sep 11 16:24:02.413668 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.413628    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a17a0fd-6fc748c694-zrvzt"]
Sep 11 16:24:02.893277 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.893246    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bb6a81b-3444-4458-9fe5-eecc036d7225" path="/var/lib/kubelet/pods/2bb6a81b-3444-4458-9fe5-eecc036d7225/volumes"
Sep 11 16:24:02.893669 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:02.893654    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a37fb26-e203-4c47-826f-16fa55099c63" path="/var/lib/kubelet/pods/8a37fb26-e203-4c47-826f-16fa55099c63/volumes"
Sep 11 16:24:16.962695 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:16.962662    2557 scope.go:117] "RemoveContainer" containerID="f7fe5a06a2fdaa9a77f766d288970d38dbfaf8ecd61588a0c50d54510b2eb501"
Sep 11 16:24:16.971267 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:16.971247    2557 scope.go:117] "RemoveContainer" containerID="334d33232f0e5884a0eb21c9f0cf7bd7ca9c1b1d3ca6961701968999edc119cb"
Sep 11 16:24:54.520951 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:54.520917    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"]
Sep 11 16:24:54.521531 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:54.521162    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy" containerID="cri-o://f915ded991b57d6ddac386d218a1d2d4cdcfd42f3aa8c858aeebe1afa96f26fc" gracePeriod=30
Sep 11 16:24:59.688257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.688217    2557 generic.go:356] "Generic (PLEG): container finished" podID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerID="f915ded991b57d6ddac386d218a1d2d4cdcfd42f3aa8c858aeebe1afa96f26fc" exitCode=0
Sep 11 16:24:59.688800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.688256    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" event={"ID":"2b8472b9-51ef-4583-b6cf-0b809af5f11f","Type":"ContainerDied","Data":"f915ded991b57d6ddac386d218a1d2d4cdcfd42f3aa8c858aeebe1afa96f26fc"}
Sep 11 16:24:59.688800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.688359    2557 scope.go:117] "RemoveContainer" containerID="31dfb6f17bf3b4ebac4a9e1c1ee18cd0e35aca47db951b5611e4e17296c0e202"
Sep 11 16:24:59.777772 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.777744    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:24:59.919921 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.919882    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-certs\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.919948    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-data\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.919997    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istiod-ca-cert\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920020    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-envoy\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920098    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-token\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920155    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-credential-socket\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920193    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-podinfo\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920224    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htlsb\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-kube-api-access-htlsb\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920258    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-socket\") pod \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\" (UID: \"2b8472b9-51ef-4583-b6cf-0b809af5f11f\") "
Sep 11 16:24:59.920369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920271    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:24:59.920589 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920438    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:24:59.920589 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920446    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:24:59.920694 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920599    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:24:59.920694 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920625    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:24:59.920694 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920672    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:24:59.920852 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920688    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:24:59.920852 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.920710    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:24:59.922423 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.922391    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:24:59.922528 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.922415    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:24:59.922528 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.922445    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-kube-api-access-htlsb" (OuterVolumeSpecName: "kube-api-access-htlsb") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "kube-api-access-htlsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:24:59.922528 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:24:59.922461    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b8472b9-51ef-4583-b6cf-0b809af5f11f" (UID: "2b8472b9-51ef-4583-b6cf-0b809af5f11f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:25:00.022003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.021951    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:25:00.022003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.021993    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:25:00.022003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.022006    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b8472b9-51ef-4583-b6cf-0b809af5f11f-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:25:00.022283 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.022020    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htlsb\" (UniqueName: \"kubernetes.io/projected/2b8472b9-51ef-4583-b6cf-0b809af5f11f-kube-api-access-htlsb\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:25:00.022283 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.022034    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:25:00.022283 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.022060    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b8472b9-51ef-4583-b6cf-0b809af5f11f-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:25:00.694461 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.694430    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"
Sep 11 16:25:00.694888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.694467    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j" event={"ID":"2b8472b9-51ef-4583-b6cf-0b809af5f11f","Type":"ContainerDied","Data":"3c32a6a2170506dc9b0b8008dc2241de9307ccdea2bd094c20e3c0a423b556db"}
Sep 11 16:25:00.694888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.694528    2557 scope.go:117] "RemoveContainer" containerID="f915ded991b57d6ddac386d218a1d2d4cdcfd42f3aa8c858aeebe1afa96f26fc"
Sep 11 16:25:00.739649 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.739610    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"]
Sep 11 16:25:00.766254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.766217    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0a17a0fd-openshift-default-5688974dd8-f2m5j"]
Sep 11 16:25:00.893035 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:00.892998    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" path="/var/lib/kubelet/pods/2b8472b9-51ef-4583-b6cf-0b809af5f11f/volumes"
Sep 11 16:25:16.999611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:16.999578    2557 scope.go:117] "RemoveContainer" containerID="4e590b949648432ec8939dd1b230dc4b1af72642b7eff370a4c4b0249c6dadcc"
Sep 11 16:25:52.943757 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.943725    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"]
Sep 11 16:25:52.944189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944119    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bb6a81b-3444-4458-9fe5-eecc036d7225" containerName="payload-pre-processing"
Sep 11 16:25:52.944189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944130    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bb6a81b-3444-4458-9fe5-eecc036d7225" containerName="payload-pre-processing"
Sep 11 16:25:52.944189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944144    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy"
Sep 11 16:25:52.944189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944149    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy"
Sep 11 16:25:52.944189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944157    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a37fb26-e203-4c47-826f-16fa55099c63" containerName="revoke-keys"
Sep 11 16:25:52.944189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944162    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a37fb26-e203-4c47-826f-16fa55099c63" containerName="revoke-keys"
Sep 11 16:25:52.944411 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944229    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy"
Sep 11 16:25:52.944411 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944239    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bb6a81b-3444-4458-9fe5-eecc036d7225" containerName="payload-pre-processing"
Sep 11 16:25:52.944411 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944246    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy"
Sep 11 16:25:52.944411 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.944251    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a37fb26-e203-4c47-826f-16fa55099c63" containerName="revoke-keys"
Sep 11 16:25:52.947411 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.947392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:52.952332 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.952312    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-60e450-openshift-default-dockercfg-6nk6c\""
Sep 11 16:25:52.976580 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:52.976549    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"]
Sep 11 16:25:53.050414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.050326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-socket\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.050693 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.050662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istiod-ca-cert\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.050843 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.050830    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-data\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.050952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.050939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-credential-socket\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.051221 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.051175    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-envoy\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.051437 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.051411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-token\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.052004 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.051982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smpfm\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-kube-api-access-smpfm\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.052170 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.052116    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-certs\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.052170 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.052163    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-podinfo\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153276 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-token\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153294    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smpfm\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-kube-api-access-smpfm\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-certs\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153500 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153376    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-podinfo\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-socket\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istiod-ca-cert\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-data\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153705 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-credential-socket\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153704    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-envoy\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153849    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-certs\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.153912 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.153875    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-socket\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.154110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.154010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-data\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.154235 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.154200    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-credential-socket\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.154441 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.154417    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istiod-ca-cert\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.155848 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.155829    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-envoy\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.156197 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.156176    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-podinfo\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.162568 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.162542    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smpfm\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-kube-api-access-smpfm\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.166246 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.166229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-token\") pod \"e2e-api-a-60e450-openshift-default-8489db69dd-mr78x\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") " pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.258005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.257908    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:53.536699 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.536598    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"]
Sep 11 16:25:53.545229 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.545187    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:25:53.545321 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.545261    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:25:53.545321 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.545290    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:25:53.970697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.970644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" event={"ID":"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b","Type":"ContainerStarted","Data":"4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"}
Sep 11 16:25:53.971215 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.970732    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" event={"ID":"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b","Type":"ContainerStarted","Data":"a647efbde4c6f45a18f7c9a4c60dba55f08acc79c8f68210d3fcedcc6af03d8f"}
Sep 11 16:25:53.998957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:53.998894    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podStartSLOduration=1.998874951 podStartE2EDuration="1.998874951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:25:53.9987999 +0000 UTC m=+1417.548987753" watchObservedRunningTime="2026-09-11 16:25:53.998874951 +0000 UTC m=+1417.549062807"
Sep 11 16:25:54.259115 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:54.259003    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:54.264492 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:54.264470    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:54.977115 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:54.977080    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:25:54.978184 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:25:54.978167    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:26:03.830222 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.830177    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"]
Sep 11 16:26:03.830842 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.830820    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy"
Sep 11 16:26:03.830934 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.830846    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b8472b9-51ef-4583-b6cf-0b809af5f11f" containerName="istio-proxy"
Sep 11 16:26:03.834404 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.834380    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:03.837103 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.837080    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-60e450-dockercfg-j5kql\""
Sep 11 16:26:03.837234 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.837121    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-60e450\""
Sep 11 16:26:03.853187 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.853157    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"]
Sep 11 16:26:03.970647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.970605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:03.970824 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:03.970661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nzh4\" (UniqueName: \"kubernetes.io/projected/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-kube-api-access-7nzh4\") pod \"payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:04.071560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:04.071512    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nzh4\" (UniqueName: \"kubernetes.io/projected/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-kube-api-access-7nzh4\") pod \"payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:04.071778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:04.071712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:04.072615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:04.072594    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:04.081757 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:04.081688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nzh4\" (UniqueName: \"kubernetes.io/projected/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-kube-api-access-7nzh4\") pod \"payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:04.144676 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:04.144635    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:04.466361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:04.466259    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"]
Sep 11 16:26:04.487197 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:26:04.487161    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b15cc1_68c5_427a_a4d6_c25e0c2537e6.slice/crio-b47eefcb9a466026a19a4d67d20704ac3fcec92285f91f22ad12e8a173a06a75 WatchSource:0}: Error finding container b47eefcb9a466026a19a4d67d20704ac3fcec92285f91f22ad12e8a173a06a75: Status 404 returned error can't find the container with id b47eefcb9a466026a19a4d67d20704ac3fcec92285f91f22ad12e8a173a06a75
Sep 11 16:26:05.028985 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:05.028941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96" event={"ID":"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6","Type":"ContainerStarted","Data":"31647e1121bc2023b88cfe59cd17355fbdf7e04cbc54280e418e1c486bf2c8c3"}
Sep 11 16:26:05.029412 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:05.029008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96" event={"ID":"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6","Type":"ContainerStarted","Data":"b47eefcb9a466026a19a4d67d20704ac3fcec92285f91f22ad12e8a173a06a75"}
Sep 11 16:26:05.029412 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:05.029144    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:16.036694 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:16.036619    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:26:16.058530 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:16.058477    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96" podStartSLOduration=13.058459831 podStartE2EDuration="13.058459831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:05.063157465 +0000 UTC m=+1428.613345318" watchObservedRunningTime="2026-09-11 16:26:16.058459831 +0000 UTC m=+1439.608647683"
Sep 11 16:26:17.024271 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:17.024244    2557 scope.go:117] "RemoveContainer" containerID="616998ccfe32d983143038c914ce8ab1ab467b6b36ab9bb0fc06a749e8f7b5c5"
Sep 11 16:26:19.113264 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:19.113232    2557 generic.go:356] "Generic (PLEG): container finished" podID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerID="4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7" exitCode=0
Sep 11 16:26:19.113677 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:19.113302    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" event={"ID":"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b","Type":"ContainerDied","Data":"4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"}
Sep 11 16:26:19.113731 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:19.113717    2557 scope.go:117] "RemoveContainer" containerID="4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"
Sep 11 16:26:19.114862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:19.114839    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:19.114925 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:19.114905    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:19.114963 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:19.114937    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:20.120911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:20.120875    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" event={"ID":"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b","Type":"ContainerStarted","Data":"d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7"}
Sep 11 16:26:20.260211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:20.260176    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:26:20.260633 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:20.260607    2557 patch_prober.go:28] interesting pod/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 16:26:20.260811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:20.260785    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 16:26:21.259766 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:21.259269    2557 patch_prober.go:28] interesting pod/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 16:26:21.259766 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:21.259351    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 16:26:22.259307 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:22.259260    2557 patch_prober.go:28] interesting pod/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 16:26:22.259532 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:22.259333    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 16:26:23.258915 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:23.258871    2557 patch_prober.go:28] interesting pod/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 16:26:23.259474 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:23.258965    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 16:26:24.258780 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:24.258738    2557 patch_prober.go:28] interesting pod/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Sep 11 16:26:24.259254 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:24.259219    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Sep 11 16:26:24.977656 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:24.977614    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:26:25.361751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:25.361710    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:26:25.363003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:25.362981    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:26:26.845751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.845713    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"]
Sep 11 16:26:26.849853 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.849827    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.857370 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.857349    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4336c5-openshift-default-dockercfg-gglmv\""
Sep 11 16:26:26.866014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.865986    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"]
Sep 11 16:26:26.915506 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915452    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-credential-socket\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-token\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ff77\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-kube-api-access-7ff77\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-envoy\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915697 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-data\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915929 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915720    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-socket\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915929 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-certs\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915929 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915770    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-podinfo\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:26.915929 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:26.915807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7871d53f-100d-45de-bd59-a4a500b7e9db-istiod-ca-cert\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017170 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-data\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017375 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-socket\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017375 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017209    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-certs\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017375 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-podinfo\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017375 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7871d53f-100d-45de-bd59-a4a500b7e9db-istiod-ca-cert\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017375 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-credential-socket\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017415    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-token\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017462    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ff77\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-kube-api-access-7ff77\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-envoy\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017611    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-data\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-socket\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017891 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017773    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-credential-socket\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.017983 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.017961    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-certs\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.018074 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.018009    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7871d53f-100d-45de-bd59-a4a500b7e9db-istiod-ca-cert\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.019688 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.019664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-envoy\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.019792 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.019711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-podinfo\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.028659 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.028628    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-token\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.030191 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.030170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ff77\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-kube-api-access-7ff77\") pod \"e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") " pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.160680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.160593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:27.461617 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.461587    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"]
Sep 11 16:26:27.463846 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:26:27.463821    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7871d53f_100d_45de_bd59_a4a500b7e9db.slice/crio-603663ab5f7a1f8ca4e6e53fc802bb7c3581fdfef5a4f39bc54bc6405cce1e05 WatchSource:0}: Error finding container 603663ab5f7a1f8ca4e6e53fc802bb7c3581fdfef5a4f39bc54bc6405cce1e05: Status 404 returned error can't find the container with id 603663ab5f7a1f8ca4e6e53fc802bb7c3581fdfef5a4f39bc54bc6405cce1e05
Sep 11 16:26:27.466145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.466109    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:27.466243 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.466175    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:27.466243 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:27.466204    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:28.168811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:28.168771    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" event={"ID":"7871d53f-100d-45de-bd59-a4a500b7e9db","Type":"ContainerStarted","Data":"98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"}
Sep 11 16:26:28.169304 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:28.168827    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" event={"ID":"7871d53f-100d-45de-bd59-a4a500b7e9db","Type":"ContainerStarted","Data":"603663ab5f7a1f8ca4e6e53fc802bb7c3581fdfef5a4f39bc54bc6405cce1e05"}
Sep 11 16:26:28.212021 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:28.211958    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podStartSLOduration=2.211941082 podStartE2EDuration="2.211941082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:28.210844359 +0000 UTC m=+1451.761032211" watchObservedRunningTime="2026-09-11 16:26:28.211941082 +0000 UTC m=+1451.762128934"
Sep 11 16:26:29.161324 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:29.161280    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:29.173760 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:29.173727    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:29.176075 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:29.176051    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:29.176701 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:29.176679    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:32.453765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.453731    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"]
Sep 11 16:26:32.457602 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.457583    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.460766 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.460732    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4336c5\""
Sep 11 16:26:32.460914 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.460829    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4336c5-dockercfg-4zlmw\""
Sep 11 16:26:32.472153 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.472122    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"]
Sep 11 16:26:32.578146 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.578108    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd33d2ee-8eba-494c-bdc3-166858c05b51-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") " pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.578352 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.578158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4bdp\" (UniqueName: \"kubernetes.io/projected/dd33d2ee-8eba-494c-bdc3-166858c05b51-kube-api-access-l4bdp\") pod \"payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") " pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.679740 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.679699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd33d2ee-8eba-494c-bdc3-166858c05b51-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") " pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.679936 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.679750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4bdp\" (UniqueName: \"kubernetes.io/projected/dd33d2ee-8eba-494c-bdc3-166858c05b51-kube-api-access-l4bdp\") pod \"payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") " pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.680474 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.680453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd33d2ee-8eba-494c-bdc3-166858c05b51-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") " pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.689872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.689845    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4bdp\" (UniqueName: \"kubernetes.io/projected/dd33d2ee-8eba-494c-bdc3-166858c05b51-kube-api-access-l4bdp\") pod \"payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") " pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:32.768186 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:32.768099    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:33.051854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:33.051772    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"]
Sep 11 16:26:33.054560 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:26:33.054534    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd33d2ee_8eba_494c_bdc3_166858c05b51.slice/crio-76b18a43756c9554d231d65d280fc8c1e49a6dceb2811185730e5ec1954e4d88 WatchSource:0}: Error finding container 76b18a43756c9554d231d65d280fc8c1e49a6dceb2811185730e5ec1954e4d88: Status 404 returned error can't find the container with id 76b18a43756c9554d231d65d280fc8c1e49a6dceb2811185730e5ec1954e4d88
Sep 11 16:26:33.201653 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:33.201313    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km" event={"ID":"dd33d2ee-8eba-494c-bdc3-166858c05b51","Type":"ContainerStarted","Data":"37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c"}
Sep 11 16:26:33.201653 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:33.201377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km" event={"ID":"dd33d2ee-8eba-494c-bdc3-166858c05b51","Type":"ContainerStarted","Data":"76b18a43756c9554d231d65d280fc8c1e49a6dceb2811185730e5ec1954e4d88"}
Sep 11 16:26:33.201653 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:33.201419    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:33.223774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:33.223700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km" podStartSLOduration=1.223679617 podStartE2EDuration="1.223679617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:33.22250308 +0000 UTC m=+1456.772690932" watchObservedRunningTime="2026-09-11 16:26:33.223679617 +0000 UTC m=+1456.773867475"
Sep 11 16:26:44.208675 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:44.208639    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:26:53.322390 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:53.322351    2557 generic.go:356] "Generic (PLEG): container finished" podID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerID="98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37" exitCode=0
Sep 11 16:26:53.322980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:53.322430    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" event={"ID":"7871d53f-100d-45de-bd59-a4a500b7e9db","Type":"ContainerDied","Data":"98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"}
Sep 11 16:26:53.323069 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:53.323039    2557 scope.go:117] "RemoveContainer" containerID="98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"
Sep 11 16:26:53.324528 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:53.324491    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:53.324636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:53.324584    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:53.324636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:53.324622    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:26:54.330336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:54.330286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" event={"ID":"7871d53f-100d-45de-bd59-a4a500b7e9db","Type":"ContainerStarted","Data":"1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992"}
Sep 11 16:26:55.162268 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:55.162221    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:55.162602 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:55.162390    2557 patch_prober.go:28] interesting pod/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 16:26:55.162602 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:55.162439    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 16:26:56.161602 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:56.161563    2557 patch_prober.go:28] interesting pod/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 16:26:56.162218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:56.162184    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 16:26:57.162025 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:57.161977    2557 patch_prober.go:28] interesting pod/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 16:26:57.162579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:57.162073    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 16:26:57.999935 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:57.999897    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"]
Sep 11 16:26:58.003612 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.003594    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:26:58.009038 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.009011    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:26:58.009276 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.009256    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:26:58.018898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.018870    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"]
Sep 11 16:26:58.071071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.068697    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e52022-2dfe-4043-807f-38d18b6313b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-60e450-rtjdt\" (UID: \"b1e52022-2dfe-4043-807f-38d18b6313b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:26:58.162504 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.162464    2557 patch_prober.go:28] interesting pod/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 16:26:58.163140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.163097    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 16:26:58.169883 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.169834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e52022-2dfe-4043-807f-38d18b6313b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-60e450-rtjdt\" (UID: \"b1e52022-2dfe-4043-807f-38d18b6313b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:26:58.170723 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.170696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e52022-2dfe-4043-807f-38d18b6313b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-60e450-rtjdt\" (UID: \"b1e52022-2dfe-4043-807f-38d18b6313b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:26:58.313465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.313431    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:26:58.644798 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:58.644746    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"]
Sep 11 16:26:59.162389 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:59.161895    2557 patch_prober.go:28] interesting pod/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Sep 11 16:26:59.162389 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:59.161960    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Sep 11 16:26:59.176638 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:59.176584    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:26:59.390545 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:59.390451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt" event={"ID":"b1e52022-2dfe-4043-807f-38d18b6313b4","Type":"ContainerStarted","Data":"261de272cd9e4d7dc249cf9cde7ce6780f66af4a43a64545aa6a352702a5689b"}
Sep 11 16:26:59.390545 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:59.390511    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt" event={"ID":"b1e52022-2dfe-4043-807f-38d18b6313b4","Type":"ContainerStarted","Data":"4ca196a33869920243d47d5ac742e47815c634a42dbb95afeebc84bfa5d7ba05"}
Sep 11 16:26:59.412278 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:26:59.412226    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt" podStartSLOduration=2.412198085 podStartE2EDuration="2.412198085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:26:59.410368097 +0000 UTC m=+1482.960555954" watchObservedRunningTime="2026-09-11 16:26:59.412198085 +0000 UTC m=+1482.962385937"
Sep 11 16:27:00.165807 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:00.165768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:27:00.166695 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:00.166674    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:27:00.398056 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:00.398017    2557 generic.go:356] "Generic (PLEG): container finished" podID="b1e52022-2dfe-4043-807f-38d18b6313b4" containerID="261de272cd9e4d7dc249cf9cde7ce6780f66af4a43a64545aa6a352702a5689b" exitCode=0
Sep 11 16:27:00.398252 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:00.398118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt" event={"ID":"b1e52022-2dfe-4043-807f-38d18b6313b4","Type":"ContainerDied","Data":"261de272cd9e4d7dc249cf9cde7ce6780f66af4a43a64545aa6a352702a5689b"}
Sep 11 16:27:01.553490 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:01.553464    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:27:01.607218 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:01.607163    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e52022-2dfe-4043-807f-38d18b6313b4-maas-api-service-ca\") pod \"b1e52022-2dfe-4043-807f-38d18b6313b4\" (UID: \"b1e52022-2dfe-4043-807f-38d18b6313b4\") "
Sep 11 16:27:01.607628 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:01.607598    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1e52022-2dfe-4043-807f-38d18b6313b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b1e52022-2dfe-4043-807f-38d18b6313b4" (UID: "b1e52022-2dfe-4043-807f-38d18b6313b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:01.709208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:01.709114    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1e52022-2dfe-4043-807f-38d18b6313b4-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:02.412311 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:02.412278    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"
Sep 11 16:27:02.412503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:02.412308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt" event={"ID":"b1e52022-2dfe-4043-807f-38d18b6313b4","Type":"ContainerDied","Data":"4ca196a33869920243d47d5ac742e47815c634a42dbb95afeebc84bfa5d7ba05"}
Sep 11 16:27:02.412503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:02.412358    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ca196a33869920243d47d5ac742e47815c634a42dbb95afeebc84bfa5d7ba05"
Sep 11 16:27:14.225577 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.225540    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"]
Sep 11 16:27:14.225991 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.225844    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96" podUID="b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" containerName="payload-pre-processing" containerID="cri-o://31647e1121bc2023b88cfe59cd17355fbdf7e04cbc54280e418e1c486bf2c8c3" gracePeriod=30
Sep 11 16:27:14.405716 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.405660    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"]
Sep 11 16:27:14.409587 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.409524    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-60e450-rtjdt"]
Sep 11 16:27:14.496123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.488971    2557 generic.go:356] "Generic (PLEG): container finished" podID="b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" containerID="31647e1121bc2023b88cfe59cd17355fbdf7e04cbc54280e418e1c486bf2c8c3" exitCode=0
Sep 11 16:27:14.496123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.489088    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96" event={"ID":"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6","Type":"ContainerDied","Data":"31647e1121bc2023b88cfe59cd17355fbdf7e04cbc54280e418e1c486bf2c8c3"}
Sep 11 16:27:14.496123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.489144    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96" event={"ID":"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6","Type":"ContainerDied","Data":"b47eefcb9a466026a19a4d67d20704ac3fcec92285f91f22ad12e8a173a06a75"}
Sep 11 16:27:14.496123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.489169    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b47eefcb9a466026a19a4d67d20704ac3fcec92285f91f22ad12e8a173a06a75"
Sep 11 16:27:14.499634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.499595    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:27:14.642094 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.642027    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-plugins-config-volume\") pod \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") "
Sep 11 16:27:14.642263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.642109    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nzh4\" (UniqueName: \"kubernetes.io/projected/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-kube-api-access-7nzh4\") pod \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\" (UID: \"b3b15cc1-68c5-427a-a4d6-c25e0c2537e6\") "
Sep 11 16:27:14.642479 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.642452    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" (UID: "b3b15cc1-68c5-427a-a4d6-c25e0c2537e6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:14.644263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.644238    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-kube-api-access-7nzh4" (OuterVolumeSpecName: "kube-api-access-7nzh4") pod "b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" (UID: "b3b15cc1-68c5-427a-a4d6-c25e0c2537e6"). InnerVolumeSpecName "kube-api-access-7nzh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:14.743453 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.743406    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:14.743453 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.743443    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nzh4\" (UniqueName: \"kubernetes.io/projected/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6-kube-api-access-7nzh4\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:14.893619 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:14.893582    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1e52022-2dfe-4043-807f-38d18b6313b4" path="/var/lib/kubelet/pods/b1e52022-2dfe-4043-807f-38d18b6313b4/volumes"
Sep 11 16:27:15.494790 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:15.494753    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"
Sep 11 16:27:15.511819 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:15.511643    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"]
Sep 11 16:27:15.513784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:15.513759    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-60e450-6d976d495d-swz96"]
Sep 11 16:27:16.894076 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:16.894022    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" path="/var/lib/kubelet/pods/b3b15cc1-68c5-427a-a4d6-c25e0c2537e6/volumes"
Sep 11 16:27:16.918003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:16.917975    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:27:16.920556 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:16.920529    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:27:17.045412 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:17.045380    2557 scope.go:117] "RemoveContainer" containerID="7ada2dae6a2934da6aa12a38c298d9846efd88847194527ca2eab966f9e52d75"
Sep 11 16:27:17.054503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:17.054479    2557 scope.go:117] "RemoveContainer" containerID="c30428322e97afeaa62848f40937575abd5711b8c1d61d7a173ec22c82c068a9"
Sep 11 16:27:17.062816 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:17.062793    2557 scope.go:117] "RemoveContainer" containerID="de4eb9f4c0c9a148eb6a0e0d1c75139a8bc690f188128683f83f90eb7c0734d3"
Sep 11 16:27:21.218457 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.218420    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"]
Sep 11 16:27:21.218891 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.218615    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" containerID="cri-o://d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7" gracePeriod=30
Sep 11 16:27:21.573057 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573006    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"]
Sep 11 16:27:21.573476 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573461    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e52022-2dfe-4043-807f-38d18b6313b4" containerName="revoke-keys"
Sep 11 16:27:21.573476 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573476    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e52022-2dfe-4043-807f-38d18b6313b4" containerName="revoke-keys"
Sep 11 16:27:21.573565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573490    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" containerName="payload-pre-processing"
Sep 11 16:27:21.573565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573496    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" containerName="payload-pre-processing"
Sep 11 16:27:21.573634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573565    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e52022-2dfe-4043-807f-38d18b6313b4" containerName="revoke-keys"
Sep 11 16:27:21.573634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.573576    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b15cc1-68c5-427a-a4d6-c25e0c2537e6" containerName="payload-pre-processing"
Sep 11 16:27:21.576913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.576892    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:21.579844 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.579818    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:27:21.579974 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.579818    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:27:21.585569 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.585543    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"]
Sep 11 16:27:21.710016 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.709954    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be25667-3630-4ac3-931e-9c0c34057d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs\" (UID: \"4be25667-3630-4ac3-931e-9c0c34057d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:21.811257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.811208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be25667-3630-4ac3-931e-9c0c34057d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs\" (UID: \"4be25667-3630-4ac3-931e-9c0c34057d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:21.811841 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.811817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be25667-3630-4ac3-931e-9c0c34057d44-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs\" (UID: \"4be25667-3630-4ac3-931e-9c0c34057d44\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:21.888804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:21.888717    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:22.171494 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:22.171468    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"]
Sep 11 16:27:22.173636 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:27:22.173602    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4be25667_3630_4ac3_931e_9c0c34057d44.slice/crio-7174aee1560753c8904a776f75f686cba11c91dba5e448c89f51eda3d903904d WatchSource:0}: Error finding container 7174aee1560753c8904a776f75f686cba11c91dba5e448c89f51eda3d903904d: Status 404 returned error can't find the container with id 7174aee1560753c8904a776f75f686cba11c91dba5e448c89f51eda3d903904d
Sep 11 16:27:22.535495 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:22.535458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs" event={"ID":"4be25667-3630-4ac3-931e-9c0c34057d44","Type":"ContainerStarted","Data":"fb59ce8aa9da8f06b2123296eb1f0587a02a2d5b11ad36f121df16554f315686"}
Sep 11 16:27:22.535883 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:22.535510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs" event={"ID":"4be25667-3630-4ac3-931e-9c0c34057d44","Type":"ContainerStarted","Data":"7174aee1560753c8904a776f75f686cba11c91dba5e448c89f51eda3d903904d"}
Sep 11 16:27:22.553838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:22.553776    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs" podStartSLOduration=1.5537524230000002 podStartE2EDuration="1.553752423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:27:22.553386416 +0000 UTC m=+1506.103574268" watchObservedRunningTime="2026-09-11 16:27:22.553752423 +0000 UTC m=+1506.103940277"
Sep 11 16:27:23.543704 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:23.543668    2557 generic.go:356] "Generic (PLEG): container finished" podID="4be25667-3630-4ac3-931e-9c0c34057d44" containerID="fb59ce8aa9da8f06b2123296eb1f0587a02a2d5b11ad36f121df16554f315686" exitCode=0
Sep 11 16:27:23.544136 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:23.543756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs" event={"ID":"4be25667-3630-4ac3-931e-9c0c34057d44","Type":"ContainerDied","Data":"fb59ce8aa9da8f06b2123296eb1f0587a02a2d5b11ad36f121df16554f315686"}
Sep 11 16:27:24.686888 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:24.686857    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:24.844178 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:24.844079    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be25667-3630-4ac3-931e-9c0c34057d44-maas-api-service-ca\") pod \"4be25667-3630-4ac3-931e-9c0c34057d44\" (UID: \"4be25667-3630-4ac3-931e-9c0c34057d44\") "
Sep 11 16:27:24.844462 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:24.844438    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4be25667-3630-4ac3-931e-9c0c34057d44-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4be25667-3630-4ac3-931e-9c0c34057d44" (UID: "4be25667-3630-4ac3-931e-9c0c34057d44"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:24.945494 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:24.945457    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4be25667-3630-4ac3-931e-9c0c34057d44-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:25.364611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:25.364573    2557 patch_prober.go:28] interesting pod/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:27:25.364860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:25.364651    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:27:25.556253 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:25.556222    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"
Sep 11 16:27:25.556253 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:25.556249    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs" event={"ID":"4be25667-3630-4ac3-931e-9c0c34057d44","Type":"ContainerDied","Data":"7174aee1560753c8904a776f75f686cba11c91dba5e448c89f51eda3d903904d"}
Sep 11 16:27:25.556489 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:25.556307    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7174aee1560753c8904a776f75f686cba11c91dba5e448c89f51eda3d903904d"
Sep 11 16:27:26.479294 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.479264    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:27:26.563189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.563150    2557 generic.go:356] "Generic (PLEG): container finished" podID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerID="d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7" exitCode=0
Sep 11 16:27:26.563383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.563207    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"
Sep 11 16:27:26.563383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.563236    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" event={"ID":"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b","Type":"ContainerDied","Data":"d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7"}
Sep 11 16:27:26.563383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.563306    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x" event={"ID":"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b","Type":"ContainerDied","Data":"a647efbde4c6f45a18f7c9a4c60dba55f08acc79c8f68210d3fcedcc6af03d8f"}
Sep 11 16:27:26.563383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.563340    2557 scope.go:117] "RemoveContainer" containerID="d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7"
Sep 11 16:27:26.572747 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.572723    2557 scope.go:117] "RemoveContainer" containerID="4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"
Sep 11 16:27:26.581740 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.581717    2557 scope.go:117] "RemoveContainer" containerID="d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7"
Sep 11 16:27:26.582097 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:26.582079    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7\": container with ID starting with d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7 not found: ID does not exist" containerID="d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7"
Sep 11 16:27:26.582180 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.582104    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7"} err="failed to get container status \"d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7\": rpc error: code = NotFound desc = could not find container \"d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7\": container with ID starting with d9d2f3d0170a4467156b054bd34e033d8b59989fd40fc125094e6366da9af4d7 not found: ID does not exist"
Sep 11 16:27:26.582180 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.582121    2557 scope.go:117] "RemoveContainer" containerID="4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"
Sep 11 16:27:26.582423 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:26.582402    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7\": container with ID starting with 4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7 not found: ID does not exist" containerID="4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"
Sep 11 16:27:26.582465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.582429    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7"} err="failed to get container status \"4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7\": rpc error: code = NotFound desc = could not find container \"4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7\": container with ID starting with 4c674229068547efa0f2283efe1c97645ab46a75a7faf38a85ae11ce3a3b0ec7 not found: ID does not exist"
Sep 11 16:27:26.664653 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664613    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smpfm\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-kube-api-access-smpfm\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.664846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664666    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-podinfo\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.664846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664685    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-certs\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.664846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664721    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-data\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.664846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664783    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-token\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.664846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664808    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istiod-ca-cert\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.664846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664841    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-socket\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.665211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664860    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-credential-socket\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.665211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.664896    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-envoy\") pod \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\" (UID: \"40a50b3d-ef98-4637-aa3d-bb4bd85feb0b\") "
Sep 11 16:27:26.665211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665093    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:26.665211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665138    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:26.665414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665314    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:26.665414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665347    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.665414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665369    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.665414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665378    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:26.665617 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.665516    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:26.667157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.667116    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-kube-api-access-smpfm" (OuterVolumeSpecName: "kube-api-access-smpfm") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "kube-api-access-smpfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:26.667157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.667123    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:26.667330 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.667256    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:26.667330 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.667257    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" (UID: "40a50b3d-ef98-4637-aa3d-bb4bd85feb0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:27:26.766666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766626    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smpfm\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-kube-api-access-smpfm\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.766666 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766664    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.766876 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766681    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.766876 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766693    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.766876 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766707    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.766876 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766719    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.766876 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.766732    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:26.894262 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.894230    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"]
Sep 11 16:27:26.894262 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:26.894259    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-60e450-openshift-default-8489db69dd-mr78x"]
Sep 11 16:27:28.892978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:28.892942    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" path="/var/lib/kubelet/pods/40a50b3d-ef98-4637-aa3d-bb4bd85feb0b/volumes"
Sep 11 16:27:37.209292 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.209250    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"]
Sep 11 16:27:37.213777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.213713    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km" podUID="dd33d2ee-8eba-494c-bdc3-166858c05b51" containerName="payload-processing" containerID="cri-o://37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c" gracePeriod=30
Sep 11 16:27:37.396460 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.396420    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"]
Sep 11 16:27:37.399778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.399737    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4336c5-k6jvs"]
Sep 11 16:27:37.487764 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.487737    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:27:37.564659 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.564521    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd33d2ee-8eba-494c-bdc3-166858c05b51-plugins-config-volume\") pod \"dd33d2ee-8eba-494c-bdc3-166858c05b51\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") "
Sep 11 16:27:37.564890 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.564759    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4bdp\" (UniqueName: \"kubernetes.io/projected/dd33d2ee-8eba-494c-bdc3-166858c05b51-kube-api-access-l4bdp\") pod \"dd33d2ee-8eba-494c-bdc3-166858c05b51\" (UID: \"dd33d2ee-8eba-494c-bdc3-166858c05b51\") "
Sep 11 16:27:37.566641 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.566146    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd33d2ee-8eba-494c-bdc3-166858c05b51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd33d2ee-8eba-494c-bdc3-166858c05b51" (UID: "dd33d2ee-8eba-494c-bdc3-166858c05b51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:37.566857 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.566825    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd33d2ee-8eba-494c-bdc3-166858c05b51-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:37.569346 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.569306    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd33d2ee-8eba-494c-bdc3-166858c05b51-kube-api-access-l4bdp" (OuterVolumeSpecName: "kube-api-access-l4bdp") pod "dd33d2ee-8eba-494c-bdc3-166858c05b51" (UID: "dd33d2ee-8eba-494c-bdc3-166858c05b51"). InnerVolumeSpecName "kube-api-access-l4bdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:37.629033 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.628988    2557 generic.go:356] "Generic (PLEG): container finished" podID="dd33d2ee-8eba-494c-bdc3-166858c05b51" containerID="37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c" exitCode=0
Sep 11 16:27:37.629230 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.629077    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"
Sep 11 16:27:37.629230 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.629086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km" event={"ID":"dd33d2ee-8eba-494c-bdc3-166858c05b51","Type":"ContainerDied","Data":"37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c"}
Sep 11 16:27:37.629230 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.629180    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km" event={"ID":"dd33d2ee-8eba-494c-bdc3-166858c05b51","Type":"ContainerDied","Data":"76b18a43756c9554d231d65d280fc8c1e49a6dceb2811185730e5ec1954e4d88"}
Sep 11 16:27:37.629230 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.629211    2557 scope.go:117] "RemoveContainer" containerID="37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c"
Sep 11 16:27:37.638991 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.638969    2557 scope.go:117] "RemoveContainer" containerID="37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c"
Sep 11 16:27:37.639492 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:37.639371    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c\": container with ID starting with 37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c not found: ID does not exist" containerID="37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c"
Sep 11 16:27:37.639492 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.639405    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c"} err="failed to get container status \"37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c\": rpc error: code = NotFound desc = could not find container \"37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c\": container with ID starting with 37ed9f20d6d7cf6e6987e13ea32901fe7040da20299eb037b7bf7da376f3cd8c not found: ID does not exist"
Sep 11 16:27:37.657838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.657804    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"]
Sep 11 16:27:37.663278 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.663245    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4336c5-5d6878c8fc-hk8km"]
Sep 11 16:27:37.668096 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:37.668071    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4bdp\" (UniqueName: \"kubernetes.io/projected/dd33d2ee-8eba-494c-bdc3-166858c05b51-kube-api-access-l4bdp\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:38.893304 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:38.893268    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be25667-3630-4ac3-931e-9c0c34057d44" path="/var/lib/kubelet/pods/4be25667-3630-4ac3-931e-9c0c34057d44/volumes"
Sep 11 16:27:38.893704 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:38.893685    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd33d2ee-8eba-494c-bdc3-166858c05b51" path="/var/lib/kubelet/pods/dd33d2ee-8eba-494c-bdc3-166858c05b51/volumes"
Sep 11 16:27:43.865894 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:43.865807    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"]
Sep 11 16:27:43.866387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:43.866105    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" containerID="cri-o://1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992" gracePeriod=30
Sep 11 16:27:44.289636 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.289536    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"]
Sep 11 16:27:44.290109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290087    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy"
Sep 11 16:27:44.290109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290110    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy"
Sep 11 16:27:44.290272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290126    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy"
Sep 11 16:27:44.290272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290134    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy"
Sep 11 16:27:44.290272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290144    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd33d2ee-8eba-494c-bdc3-166858c05b51" containerName="payload-processing"
Sep 11 16:27:44.290272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290153    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd33d2ee-8eba-494c-bdc3-166858c05b51" containerName="payload-processing"
Sep 11 16:27:44.290272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290170    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4be25667-3630-4ac3-931e-9c0c34057d44" containerName="revoke-keys"
Sep 11 16:27:44.290272 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290180    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4be25667-3630-4ac3-931e-9c0c34057d44" containerName="revoke-keys"
Sep 11 16:27:44.290560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290286    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy"
Sep 11 16:27:44.290560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290305    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="40a50b3d-ef98-4637-aa3d-bb4bd85feb0b" containerName="istio-proxy"
Sep 11 16:27:44.290560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290315    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4be25667-3630-4ac3-931e-9c0c34057d44" containerName="revoke-keys"
Sep 11 16:27:44.290560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.290325    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd33d2ee-8eba-494c-bdc3-166858c05b51" containerName="payload-processing"
Sep 11 16:27:44.294922 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.294897    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:44.298514 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.298489    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:27:44.298655 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.298529    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:27:44.306196 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.306166    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"]
Sep 11 16:27:44.341701 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.341663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n\" (UID: \"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:44.443198 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.443161    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n\" (UID: \"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:44.443847 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.443827    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n\" (UID: \"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:44.607432 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.607392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:44.886279 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:44.886252    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"]
Sep 11 16:27:44.888555 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:27:44.888530    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e0c288_f89d_4fab_9d1b_1837e7b6d5ba.slice/crio-085bb6b8a819151f499cf346089e145a1de821c81584bb6ff5ecccb3dc4d53a6 WatchSource:0}: Error finding container 085bb6b8a819151f499cf346089e145a1de821c81584bb6ff5ecccb3dc4d53a6: Status 404 returned error can't find the container with id 085bb6b8a819151f499cf346089e145a1de821c81584bb6ff5ecccb3dc4d53a6
Sep 11 16:27:45.168743 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:45.168709    2557 patch_prober.go:28] interesting pod/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:27:45.168904 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:45.168762    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:27:45.681297 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:45.681258    2557 generic.go:356] "Generic (PLEG): container finished" podID="74e0c288-f89d-4fab-9d1b-1837e7b6d5ba" containerID="45b141837731e64bd97bd2eae8e945d8bd3dbe105b6dc36c82abd5e05fac7417" exitCode=0
Sep 11 16:27:45.681481 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:45.681335    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n" event={"ID":"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba","Type":"ContainerDied","Data":"45b141837731e64bd97bd2eae8e945d8bd3dbe105b6dc36c82abd5e05fac7417"}
Sep 11 16:27:45.681481 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:45.681387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n" event={"ID":"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba","Type":"ContainerStarted","Data":"085bb6b8a819151f499cf346089e145a1de821c81584bb6ff5ecccb3dc4d53a6"}
Sep 11 16:27:46.826227 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:46.826197    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:46.972226 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:46.972127    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba-maas-api-service-ca\") pod \"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba\" (UID: \"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba\") "
Sep 11 16:27:46.972499 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:46.972474    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74e0c288-f89d-4fab-9d1b-1837e7b6d5ba" (UID: "74e0c288-f89d-4fab-9d1b-1837e7b6d5ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:47.073143 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:47.073105    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:47.693759 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:47.693727    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"
Sep 11 16:27:47.693759 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:47.693739    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n" event={"ID":"74e0c288-f89d-4fab-9d1b-1837e7b6d5ba","Type":"ContainerDied","Data":"085bb6b8a819151f499cf346089e145a1de821c81584bb6ff5ecccb3dc4d53a6"}
Sep 11 16:27:47.694017 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:47.693781    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="085bb6b8a819151f499cf346089e145a1de821c81584bb6ff5ecccb3dc4d53a6"
Sep 11 16:27:49.119980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.119954    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:27:49.196679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196597    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-token\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196679 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196655    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-credential-socket\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196686    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-podinfo\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196727    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-envoy\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196772    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7871d53f-100d-45de-bd59-a4a500b7e9db-istiod-ca-cert\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196790    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-socket\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196813    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-data\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196850    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-certs\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.196892 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.196889    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ff77\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-kube-api-access-7ff77\") pod \"7871d53f-100d-45de-bd59-a4a500b7e9db\" (UID: \"7871d53f-100d-45de-bd59-a4a500b7e9db\") "
Sep 11 16:27:49.197273 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197078    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:49.197273 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197113    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:49.197273 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197193    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7871d53f-100d-45de-bd59-a4a500b7e9db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:49.197426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197290    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-data" (OuterVolumeSpecName: "istio-data") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:49.197426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197307    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7871d53f-100d-45de-bd59-a4a500b7e9db-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.197426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197344    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.197426 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197363    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.197616 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.197586    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:49.198970 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.198945    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:27:49.199134 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.199115    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-token" (OuterVolumeSpecName: "istio-token") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:49.199194 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.199127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:27:49.199244 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.199225    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-kube-api-access-7ff77" (OuterVolumeSpecName: "kube-api-access-7ff77") pod "7871d53f-100d-45de-bd59-a4a500b7e9db" (UID: "7871d53f-100d-45de-bd59-a4a500b7e9db"). InnerVolumeSpecName "kube-api-access-7ff77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:49.298647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.298600    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.298647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.298634    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.298647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.298643    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ff77\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-kube-api-access-7ff77\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.298647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.298652    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.298647 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.298660    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.298944 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.298668    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7871d53f-100d-45de-bd59-a4a500b7e9db-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:49.705068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.705020    2557 generic.go:356] "Generic (PLEG): container finished" podID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerID="1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992" exitCode=0
Sep 11 16:27:49.705260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.705116    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"
Sep 11 16:27:49.705260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.705108    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" event={"ID":"7871d53f-100d-45de-bd59-a4a500b7e9db","Type":"ContainerDied","Data":"1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992"}
Sep 11 16:27:49.705260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.705237    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7" event={"ID":"7871d53f-100d-45de-bd59-a4a500b7e9db","Type":"ContainerDied","Data":"603663ab5f7a1f8ca4e6e53fc802bb7c3581fdfef5a4f39bc54bc6405cce1e05"}
Sep 11 16:27:49.705365 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.705269    2557 scope.go:117] "RemoveContainer" containerID="1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992"
Sep 11 16:27:49.723715 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.723693    2557 scope.go:117] "RemoveContainer" containerID="98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"
Sep 11 16:27:49.732731 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.732694    2557 scope.go:117] "RemoveContainer" containerID="1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992"
Sep 11 16:27:49.733135 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:49.733104    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992\": container with ID starting with 1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992 not found: ID does not exist" containerID="1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992"
Sep 11 16:27:49.733188 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.733152    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992"} err="failed to get container status \"1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992\": rpc error: code = NotFound desc = could not find container \"1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992\": container with ID starting with 1ca0907e3f95af2ed3a770edf6cc4dd557d51b72406b3b23d8cce610f4e80992 not found: ID does not exist"
Sep 11 16:27:49.733188 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.733186    2557 scope.go:117] "RemoveContainer" containerID="98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"
Sep 11 16:27:49.733458 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:49.733440    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37\": container with ID starting with 98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37 not found: ID does not exist" containerID="98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"
Sep 11 16:27:49.733514 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.733467    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37"} err="failed to get container status \"98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37\": rpc error: code = NotFound desc = could not find container \"98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37\": container with ID starting with 98eb7897a166147f6cfdc8ab040b602503fb091677b99f2716c97bb5bd5e0b37 not found: ID does not exist"
Sep 11 16:27:49.740573 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.740546    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"]
Sep 11 16:27:49.745338 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:49.745312    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4336c5-openshift-default-799bb9559d-84qr7"]
Sep 11 16:27:50.893210 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:50.893170    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" path="/var/lib/kubelet/pods/7871d53f-100d-45de-bd59-a4a500b7e9db/volumes"
Sep 11 16:27:54.929935 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:54.929903    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"]
Sep 11 16:27:54.930483 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:54.930228    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r" podUID="71335103-08f0-4e5b-9051-69b0e17fa4fd" containerName="payload-processing" containerID="cri-o://d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2" gracePeriod=30
Sep 11 16:27:54.940000 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:54.939970    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"]
Sep 11 16:27:54.940260 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:54.940232    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx" podUID="2f4312b2-9576-4e44-bac5-131079d25e04" containerName="payload-pre-processing" containerID="cri-o://74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374" gracePeriod=30
Sep 11 16:27:55.112640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.112542    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"]
Sep 11 16:27:55.114614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.114586    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-3db535-2td4n"]
Sep 11 16:27:55.224453 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.224419    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:27:55.227305 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.227279    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:27:55.355420 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.355372    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71335103-08f0-4e5b-9051-69b0e17fa4fd-plugins-config-volume\") pod \"71335103-08f0-4e5b-9051-69b0e17fa4fd\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") "
Sep 11 16:27:55.355597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.355432    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmzl2\" (UniqueName: \"kubernetes.io/projected/71335103-08f0-4e5b-9051-69b0e17fa4fd-kube-api-access-kmzl2\") pod \"71335103-08f0-4e5b-9051-69b0e17fa4fd\" (UID: \"71335103-08f0-4e5b-9051-69b0e17fa4fd\") "
Sep 11 16:27:55.355597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.355476    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f4312b2-9576-4e44-bac5-131079d25e04-plugins-config-volume\") pod \"2f4312b2-9576-4e44-bac5-131079d25e04\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") "
Sep 11 16:27:55.355597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.355511    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7bh6\" (UniqueName: \"kubernetes.io/projected/2f4312b2-9576-4e44-bac5-131079d25e04-kube-api-access-l7bh6\") pod \"2f4312b2-9576-4e44-bac5-131079d25e04\" (UID: \"2f4312b2-9576-4e44-bac5-131079d25e04\") "
Sep 11 16:27:55.355869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.355838    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71335103-08f0-4e5b-9051-69b0e17fa4fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71335103-08f0-4e5b-9051-69b0e17fa4fd" (UID: "71335103-08f0-4e5b-9051-69b0e17fa4fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:55.355961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.355881    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f4312b2-9576-4e44-bac5-131079d25e04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f4312b2-9576-4e44-bac5-131079d25e04" (UID: "2f4312b2-9576-4e44-bac5-131079d25e04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:27:55.357654 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.357620    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71335103-08f0-4e5b-9051-69b0e17fa4fd-kube-api-access-kmzl2" (OuterVolumeSpecName: "kube-api-access-kmzl2") pod "71335103-08f0-4e5b-9051-69b0e17fa4fd" (UID: "71335103-08f0-4e5b-9051-69b0e17fa4fd"). InnerVolumeSpecName "kube-api-access-kmzl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:55.357753 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.357704    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4312b2-9576-4e44-bac5-131079d25e04-kube-api-access-l7bh6" (OuterVolumeSpecName: "kube-api-access-l7bh6") pod "2f4312b2-9576-4e44-bac5-131079d25e04" (UID: "2f4312b2-9576-4e44-bac5-131079d25e04"). InnerVolumeSpecName "kube-api-access-l7bh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:27:55.456605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.456513    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7bh6\" (UniqueName: \"kubernetes.io/projected/2f4312b2-9576-4e44-bac5-131079d25e04-kube-api-access-l7bh6\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:55.456605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.456543    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71335103-08f0-4e5b-9051-69b0e17fa4fd-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:55.456605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.456555    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmzl2\" (UniqueName: \"kubernetes.io/projected/71335103-08f0-4e5b-9051-69b0e17fa4fd-kube-api-access-kmzl2\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:55.456605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.456568    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f4312b2-9576-4e44-bac5-131079d25e04-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:27:55.738931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.738835    2557 generic.go:356] "Generic (PLEG): container finished" podID="71335103-08f0-4e5b-9051-69b0e17fa4fd" containerID="d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2" exitCode=0
Sep 11 16:27:55.738931 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.738911    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"
Sep 11 16:27:55.739184 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.738920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r" event={"ID":"71335103-08f0-4e5b-9051-69b0e17fa4fd","Type":"ContainerDied","Data":"d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2"}
Sep 11 16:27:55.739184 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.739016    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r" event={"ID":"71335103-08f0-4e5b-9051-69b0e17fa4fd","Type":"ContainerDied","Data":"e5af25d90889ae3a6958c005a13fd03d823969b71dc8b826219c7e1ec3bfbb77"}
Sep 11 16:27:55.739184 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.739075    2557 scope.go:117] "RemoveContainer" containerID="d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2"
Sep 11 16:27:55.740378 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.740349    2557 generic.go:356] "Generic (PLEG): container finished" podID="2f4312b2-9576-4e44-bac5-131079d25e04" containerID="74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374" exitCode=0
Sep 11 16:27:55.740484 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.740416    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"
Sep 11 16:27:55.740484 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.740438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx" event={"ID":"2f4312b2-9576-4e44-bac5-131079d25e04","Type":"ContainerDied","Data":"74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374"}
Sep 11 16:27:55.740558 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.740486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx" event={"ID":"2f4312b2-9576-4e44-bac5-131079d25e04","Type":"ContainerDied","Data":"c086effd99e409088a5c556e3e663ec87140221bf8d136c60ee14c5e990b5b1f"}
Sep 11 16:27:55.748175 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.747991    2557 scope.go:117] "RemoveContainer" containerID="d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2"
Sep 11 16:27:55.748401 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:55.748370    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2\": container with ID starting with d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2 not found: ID does not exist" containerID="d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2"
Sep 11 16:27:55.748543 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.748409    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2"} err="failed to get container status \"d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2\": rpc error: code = NotFound desc = could not find container \"d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2\": container with ID starting with d5bcbc34f03a2a280b2d3b9232ecb5322d0a445870ce262b9bfc3fd69800d0c2 not found: ID does not exist"
Sep 11 16:27:55.748543 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.748436    2557 scope.go:117] "RemoveContainer" containerID="74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374"
Sep 11 16:27:55.756746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.756726    2557 scope.go:117] "RemoveContainer" containerID="74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374"
Sep 11 16:27:55.757035 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:27:55.757016    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374\": container with ID starting with 74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374 not found: ID does not exist" containerID="74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374"
Sep 11 16:27:55.757225 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.757202    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374"} err="failed to get container status \"74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374\": rpc error: code = NotFound desc = could not find container \"74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374\": container with ID starting with 74dd80468a37a4ffa0b3d5f5860326b705dd8c1d8e4ab114c7647975250dc374 not found: ID does not exist"
Sep 11 16:27:55.785130 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.785093    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"]
Sep 11 16:27:55.793597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.793564    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-3db535-78b67f6d98-8cfzx"]
Sep 11 16:27:55.814075 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.814031    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"]
Sep 11 16:27:55.820174 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:55.820148    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-3db535-bf87c95bf-zq54r"]
Sep 11 16:27:56.892960 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:56.892926    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f4312b2-9576-4e44-bac5-131079d25e04" path="/var/lib/kubelet/pods/2f4312b2-9576-4e44-bac5-131079d25e04/volumes"
Sep 11 16:27:56.893440 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:56.893312    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71335103-08f0-4e5b-9051-69b0e17fa4fd" path="/var/lib/kubelet/pods/71335103-08f0-4e5b-9051-69b0e17fa4fd/volumes"
Sep 11 16:27:56.893591 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:27:56.893578    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e0c288-f89d-4fab-9d1b-1837e7b6d5ba" path="/var/lib/kubelet/pods/74e0c288-f89d-4fab-9d1b-1837e7b6d5ba/volumes"
Sep 11 16:28:02.658463 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658426    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"]
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658837    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658850    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658862    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658867    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658875    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e0c288-f89d-4fab-9d1b-1837e7b6d5ba" containerName="revoke-keys"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658881    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e0c288-f89d-4fab-9d1b-1837e7b6d5ba" containerName="revoke-keys"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658893    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71335103-08f0-4e5b-9051-69b0e17fa4fd" containerName="payload-processing"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658902    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="71335103-08f0-4e5b-9051-69b0e17fa4fd" containerName="payload-processing"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658915    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4312b2-9576-4e44-bac5-131079d25e04" containerName="payload-pre-processing"
Sep 11 16:28:02.658952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658921    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4312b2-9576-4e44-bac5-131079d25e04" containerName="payload-pre-processing"
Sep 11 16:28:02.659512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658974    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="71335103-08f0-4e5b-9051-69b0e17fa4fd" containerName="payload-processing"
Sep 11 16:28:02.659512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658987    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy"
Sep 11 16:28:02.659512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.658997    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7871d53f-100d-45de-bd59-a4a500b7e9db" containerName="istio-proxy"
Sep 11 16:28:02.659512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.659003    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f4312b2-9576-4e44-bac5-131079d25e04" containerName="payload-pre-processing"
Sep 11 16:28:02.659512 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.659009    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e0c288-f89d-4fab-9d1b-1837e7b6d5ba" containerName="revoke-keys"
Sep 11 16:28:02.663622 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.663598    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:02.666433 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.666405    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:28:02.666570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.666415    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:28:02.671564 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.671529    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"]
Sep 11 16:28:02.828948 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.828911    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caa88382-a2a7-4191-ad4c-be6ac565adae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt\" (UID: \"caa88382-a2a7-4191-ad4c-be6ac565adae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:02.930231 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.930124    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caa88382-a2a7-4191-ad4c-be6ac565adae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt\" (UID: \"caa88382-a2a7-4191-ad4c-be6ac565adae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:02.930831 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.930808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caa88382-a2a7-4191-ad4c-be6ac565adae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt\" (UID: \"caa88382-a2a7-4191-ad4c-be6ac565adae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:02.976503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:02.976468    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:03.255199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:03.255104    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"]
Sep 11 16:28:03.259201 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:28:03.259171    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa88382_a2a7_4191_ad4c_be6ac565adae.slice/crio-5e60f4d8d155a3bec3b49e35019106dcda60b5b840d624d0ccd060fdcd5161a3 WatchSource:0}: Error finding container 5e60f4d8d155a3bec3b49e35019106dcda60b5b840d624d0ccd060fdcd5161a3: Status 404 returned error can't find the container with id 5e60f4d8d155a3bec3b49e35019106dcda60b5b840d624d0ccd060fdcd5161a3
Sep 11 16:28:03.791511 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:03.791474    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt" event={"ID":"caa88382-a2a7-4191-ad4c-be6ac565adae","Type":"ContainerStarted","Data":"0788d74db21791ae16d412f599d0d6f7fa6a59cfbd6f82277ed83999b415b904"}
Sep 11 16:28:03.791896 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:03.791534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt" event={"ID":"caa88382-a2a7-4191-ad4c-be6ac565adae","Type":"ContainerStarted","Data":"5e60f4d8d155a3bec3b49e35019106dcda60b5b840d624d0ccd060fdcd5161a3"}
Sep 11 16:28:03.811803 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:03.811694    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt" podStartSLOduration=1.811676232 podStartE2EDuration="1.811676232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:28:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:28:03.810885736 +0000 UTC m=+1547.361073610" watchObservedRunningTime="2026-09-11 16:28:03.811676232 +0000 UTC m=+1547.361864084"
Sep 11 16:28:04.797986 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:04.797951    2557 generic.go:356] "Generic (PLEG): container finished" podID="caa88382-a2a7-4191-ad4c-be6ac565adae" containerID="0788d74db21791ae16d412f599d0d6f7fa6a59cfbd6f82277ed83999b415b904" exitCode=0
Sep 11 16:28:04.798392 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:04.798036    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt" event={"ID":"caa88382-a2a7-4191-ad4c-be6ac565adae","Type":"ContainerDied","Data":"0788d74db21791ae16d412f599d0d6f7fa6a59cfbd6f82277ed83999b415b904"}
Sep 11 16:28:05.935468 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:05.935444    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:06.060986 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:06.060889    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caa88382-a2a7-4191-ad4c-be6ac565adae-maas-api-service-ca\") pod \"caa88382-a2a7-4191-ad4c-be6ac565adae\" (UID: \"caa88382-a2a7-4191-ad4c-be6ac565adae\") "
Sep 11 16:28:06.061274 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:06.061253    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caa88382-a2a7-4191-ad4c-be6ac565adae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "caa88382-a2a7-4191-ad4c-be6ac565adae" (UID: "caa88382-a2a7-4191-ad4c-be6ac565adae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:28:06.162032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:06.161991    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caa88382-a2a7-4191-ad4c-be6ac565adae-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:06.810103 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:06.810064    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt" event={"ID":"caa88382-a2a7-4191-ad4c-be6ac565adae","Type":"ContainerDied","Data":"5e60f4d8d155a3bec3b49e35019106dcda60b5b840d624d0ccd060fdcd5161a3"}
Sep 11 16:28:06.810103 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:06.810093    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"
Sep 11 16:28:06.810317 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:06.810113    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e60f4d8d155a3bec3b49e35019106dcda60b5b840d624d0ccd060fdcd5161a3"
Sep 11 16:28:13.831845 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:13.831806    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"]
Sep 11 16:28:13.837774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:13.837741    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7ce5d6-vh2qt"]
Sep 11 16:28:14.892802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:14.892766    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caa88382-a2a7-4191-ad4c-be6ac565adae" path="/var/lib/kubelet/pods/caa88382-a2a7-4191-ad4c-be6ac565adae/volumes"
Sep 11 16:28:22.451157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:22.451126    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"]
Sep 11 16:28:22.451565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:22.451320    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" containerID="cri-o://edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245" gracePeriod=30
Sep 11 16:28:26.758185 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:26.758139    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:28:26.758583 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:26.758222    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:28:27.696247 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.696219    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:28:27.748555 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748471    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-credential-socket\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748555 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748550    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-token\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748575    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63de9db0-3fc3-4310-b50c-09d84d00071b-istiod-ca-cert\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748599    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-envoy\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748626    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-certs\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748730    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-podinfo\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748793    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748807    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-socket\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.748869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748855    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-data\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.749237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.748905    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24cmh\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-kube-api-access-24cmh\") pod \"63de9db0-3fc3-4310-b50c-09d84d00071b\" (UID: \"63de9db0-3fc3-4310-b50c-09d84d00071b\") "
Sep 11 16:28:27.749237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.749038    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63de9db0-3fc3-4310-b50c-09d84d00071b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:28:27.749434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.749286    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.749434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.749305    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63de9db0-3fc3-4310-b50c-09d84d00071b-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.749434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.749317    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:27.749434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.749353    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-data" (OuterVolumeSpecName: "istio-data") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:27.749434 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.749365    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:27.750942 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.750913    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-token" (OuterVolumeSpecName: "istio-token") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:28:27.751124 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.750960    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:28:27.751281 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.751234    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:28:27.751353 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.751319    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-kube-api-access-24cmh" (OuterVolumeSpecName: "kube-api-access-24cmh") pod "63de9db0-3fc3-4310-b50c-09d84d00071b" (UID: "63de9db0-3fc3-4310-b50c-09d84d00071b"). InnerVolumeSpecName "kube-api-access-24cmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:28:27.850207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850167    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.850207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850197    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.850207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850207    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24cmh\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-kube-api-access-24cmh\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.850207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850216    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.850207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850225    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.850804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850233    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63de9db0-3fc3-4310-b50c-09d84d00071b-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.850804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.850241    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63de9db0-3fc3-4310-b50c-09d84d00071b-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:28:27.919401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.919364    2557 generic.go:356] "Generic (PLEG): container finished" podID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerID="edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245" exitCode=0
Sep 11 16:28:27.919582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.919411    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"
Sep 11 16:28:27.919582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.919446    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" event={"ID":"63de9db0-3fc3-4310-b50c-09d84d00071b","Type":"ContainerDied","Data":"edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245"}
Sep 11 16:28:27.919582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.919505    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686" event={"ID":"63de9db0-3fc3-4310-b50c-09d84d00071b","Type":"ContainerDied","Data":"978539b9053fe91470940dc3dd172d423482e5b81a975037f2d54dcd15660555"}
Sep 11 16:28:27.919582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.919528    2557 scope.go:117] "RemoveContainer" containerID="edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245"
Sep 11 16:28:27.929940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.929916    2557 scope.go:117] "RemoveContainer" containerID="f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"
Sep 11 16:28:27.938708 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.938688    2557 scope.go:117] "RemoveContainer" containerID="edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245"
Sep 11 16:28:27.939101 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:28:27.939079    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245\": container with ID starting with edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245 not found: ID does not exist" containerID="edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245"
Sep 11 16:28:27.939157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.939113    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245"} err="failed to get container status \"edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245\": rpc error: code = NotFound desc = could not find container \"edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245\": container with ID starting with edbf7877e5dafba58b6cc2873fde6435ee7b38eab2c04910ab9d8a463232e245 not found: ID does not exist"
Sep 11 16:28:27.939157 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.939132    2557 scope.go:117] "RemoveContainer" containerID="f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"
Sep 11 16:28:27.939371 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:28:27.939358    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d\": container with ID starting with f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d not found: ID does not exist" containerID="f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"
Sep 11 16:28:27.939413 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.939377    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d"} err="failed to get container status \"f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d\": rpc error: code = NotFound desc = could not find container \"f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d\": container with ID starting with f64fbbda6ddd6d0c050798172768aa6f657df3cb60559ac02c0f3c0574a73f4d not found: ID does not exist"
Sep 11 16:28:27.947561 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.947533    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"]
Sep 11 16:28:27.952660 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:27.952629    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-7ce5d6-openshift-default-7f58cd8d4d-t5686"]
Sep 11 16:28:28.892552 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:28.892520    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" path="/var/lib/kubelet/pods/63de9db0-3fc3-4310-b50c-09d84d00071b/volumes"
Sep 11 16:28:51.943403 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"]
Sep 11 16:28:51.943778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943746    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy"
Sep 11 16:28:51.943778 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943757    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy"
Sep 11 16:28:51.943854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943779    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy"
Sep 11 16:28:51.943854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943785    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy"
Sep 11 16:28:51.943854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943796    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caa88382-a2a7-4191-ad4c-be6ac565adae" containerName="revoke-keys"
Sep 11 16:28:51.943854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943802    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caa88382-a2a7-4191-ad4c-be6ac565adae" containerName="revoke-keys"
Sep 11 16:28:51.943976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943856    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy"
Sep 11 16:28:51.943976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943863    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="caa88382-a2a7-4191-ad4c-be6ac565adae" containerName="revoke-keys"
Sep 11 16:28:51.943976 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.943869    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="63de9db0-3fc3-4310-b50c-09d84d00071b" containerName="istio-proxy"
Sep 11 16:28:51.946975 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.946950    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:51.954799 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.954776    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9bac29-openshift-default-dockercfg-m9dnn\""
Sep 11 16:28:51.976297 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:51.976254    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"]
Sep 11 16:28:52.084989 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.084948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqbp\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-kube-api-access-jtqbp\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.084989 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.084995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-credential-socket\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085235 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085012    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2803582-6801-4626-ba78-8602e53bb230-istiod-ca-cert\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085235 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085040    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-socket\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085235 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-data\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085235 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2803582-6801-4626-ba78-8602e53bb230-istio-podinfo\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085377 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085248    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-certs\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085377 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085279    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-istio-token\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.085377 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.085303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-envoy\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.185804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-data\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185824    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2803582-6801-4626-ba78-8602e53bb230-istio-podinfo\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185856    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-certs\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-istio-token\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-envoy\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqbp\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-kube-api-access-jtqbp\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185971    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-credential-socket\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.185994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2803582-6801-4626-ba78-8602e53bb230-istiod-ca-cert\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186428 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.186038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-socket\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186428 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.186288    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-data\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186536 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.186446    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-credential-socket\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186536 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.186472    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-certs\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186536 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.186514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-socket\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.186826 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.186804    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2803582-6801-4626-ba78-8602e53bb230-istiod-ca-cert\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.188198 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.188177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-envoy\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.188302 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.188289    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2803582-6801-4626-ba78-8602e53bb230-istio-podinfo\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.195644 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.195576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-istio-token\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.198098 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.198074    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqbp\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-kube-api-access-jtqbp\") pod \"e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") " pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.257378 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.257340    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:52.540642 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.540613    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"]
Sep 11 16:28:52.543094 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:28:52.543062    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2803582_6801_4626_ba78_8602e53bb230.slice/crio-acf26e1f01599d98c08b8509ea2662e8f3db0d623b27e3d492cc0e69796b5f80 WatchSource:0}: Error finding container acf26e1f01599d98c08b8509ea2662e8f3db0d623b27e3d492cc0e69796b5f80: Status 404 returned error can't find the container with id acf26e1f01599d98c08b8509ea2662e8f3db0d623b27e3d492cc0e69796b5f80
Sep 11 16:28:52.545279 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.545246    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:28:52.545333 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.545317    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:28:52.545368 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:52.545344    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:28:53.062656 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:53.062618    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" event={"ID":"b2803582-6801-4626-ba78-8602e53bb230","Type":"ContainerStarted","Data":"a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"}
Sep 11 16:28:53.063156 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:53.062684    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" event={"ID":"b2803582-6801-4626-ba78-8602e53bb230","Type":"ContainerStarted","Data":"acf26e1f01599d98c08b8509ea2662e8f3db0d623b27e3d492cc0e69796b5f80"}
Sep 11 16:28:53.094009 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:53.093950    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podStartSLOduration=2.093931756 podStartE2EDuration="2.093931756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:28:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:28:53.091227519 +0000 UTC m=+1596.641415371" watchObservedRunningTime="2026-09-11 16:28:53.093931756 +0000 UTC m=+1596.644119600"
Sep 11 16:28:53.257614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:53.257516    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:53.263123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:53.263091    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:54.067869 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:54.067842    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:54.068870 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:54.068846    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:28:58.262642 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.262608    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"]
Sep 11 16:28:58.266316 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.266296    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.269732 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.269709    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-9bac29\""
Sep 11 16:28:58.270823 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.270804    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-9bac29-dockercfg-9cgtb\""
Sep 11 16:28:58.280662 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.280630    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"]
Sep 11 16:28:58.297315 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.297277    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"]
Sep 11 16:28:58.300823 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.300794    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.314134 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.314099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"]
Sep 11 16:28:58.343731 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.343689    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp27c\" (UniqueName: \"kubernetes.io/projected/fc6fe997-2fad-4986-a528-939d6e55715f-kube-api-access-xp27c\") pod \"payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.343911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.343772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6fe997-2fad-4986-a528-939d6e55715f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.445216 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.445180    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21342c6e-6de4-4c52-a840-fcb966f9119b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.445383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.445250    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp27c\" (UniqueName: \"kubernetes.io/projected/fc6fe997-2fad-4986-a528-939d6e55715f-kube-api-access-xp27c\") pod \"payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.445463 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.445368    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqnp2\" (UniqueName: \"kubernetes.io/projected/21342c6e-6de4-4c52-a840-fcb966f9119b-kube-api-access-nqnp2\") pod \"payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.445463 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.445434    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6fe997-2fad-4986-a528-939d6e55715f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.446309 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.446285    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6fe997-2fad-4986-a528-939d6e55715f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.461615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.461576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp27c\" (UniqueName: \"kubernetes.io/projected/fc6fe997-2fad-4986-a528-939d6e55715f-kube-api-access-xp27c\") pod \"payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.546265 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.546236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqnp2\" (UniqueName: \"kubernetes.io/projected/21342c6e-6de4-4c52-a840-fcb966f9119b-kube-api-access-nqnp2\") pod \"payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.546455 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.546386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21342c6e-6de4-4c52-a840-fcb966f9119b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.547106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.547083    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21342c6e-6de4-4c52-a840-fcb966f9119b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.557090 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.557036    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqnp2\" (UniqueName: \"kubernetes.io/projected/21342c6e-6de4-4c52-a840-fcb966f9119b-kube-api-access-nqnp2\") pod \"payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.577014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.576980    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:58.612169 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.612135    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:58.862530 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.862501    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"]
Sep 11 16:28:58.864430 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:28:58.864403    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6fe997_2fad_4986_a528_939d6e55715f.slice/crio-204d95b8e77e0424e1b29e698390d17ba5960ab507755f0a87f05150ba9e5645 WatchSource:0}: Error finding container 204d95b8e77e0424e1b29e698390d17ba5960ab507755f0a87f05150ba9e5645: Status 404 returned error can't find the container with id 204d95b8e77e0424e1b29e698390d17ba5960ab507755f0a87f05150ba9e5645
Sep 11 16:28:58.926715 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:58.926684    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"]
Sep 11 16:28:58.933153 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:28:58.933122    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21342c6e_6de4_4c52_a840_fcb966f9119b.slice/crio-00456216c93634e7e6d3a7ff7ee153f75368f77640121ba2b3c5e66fa8a09103 WatchSource:0}: Error finding container 00456216c93634e7e6d3a7ff7ee153f75368f77640121ba2b3c5e66fa8a09103: Status 404 returned error can't find the container with id 00456216c93634e7e6d3a7ff7ee153f75368f77640121ba2b3c5e66fa8a09103
Sep 11 16:28:59.096740 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.096701    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" event={"ID":"fc6fe997-2fad-4986-a528-939d6e55715f","Type":"ContainerStarted","Data":"1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b"}
Sep 11 16:28:59.097033 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.096767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" event={"ID":"fc6fe997-2fad-4986-a528-939d6e55715f","Type":"ContainerStarted","Data":"204d95b8e77e0424e1b29e698390d17ba5960ab507755f0a87f05150ba9e5645"}
Sep 11 16:28:59.097033 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.096916    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:28:59.098333 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.098298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" event={"ID":"21342c6e-6de4-4c52-a840-fcb966f9119b","Type":"ContainerStarted","Data":"25d2a46ab0f83b00f7d859fbc441c3626f5dab71aeb334ed195c8e066afde3d4"}
Sep 11 16:28:59.098481 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.098347    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" event={"ID":"21342c6e-6de4-4c52-a840-fcb966f9119b","Type":"ContainerStarted","Data":"00456216c93634e7e6d3a7ff7ee153f75368f77640121ba2b3c5e66fa8a09103"}
Sep 11 16:28:59.098481 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.098391    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:28:59.128231 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.128115    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" podStartSLOduration=1.1280979979999999 podStartE2EDuration="1.128097998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:28:59.125449009 +0000 UTC m=+1602.675636863" watchObservedRunningTime="2026-09-11 16:28:59.128097998 +0000 UTC m=+1602.678285850"
Sep 11 16:28:59.164987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:28:59.164932    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" podStartSLOduration=1.164912994 podStartE2EDuration="1.164912994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:28:59.163313843 +0000 UTC m=+1602.713501710" watchObservedRunningTime="2026-09-11 16:28:59.164912994 +0000 UTC m=+1602.715100901"
Sep 11 16:29:10.108717 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:10.108631    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:29:10.109140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:10.108806    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:29:10.110183 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:10.110159    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 16:29:10.110277 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:10.110226    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:29:11.166364 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:11.166332    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2803582-6801-4626-ba78-8602e53bb230" containerID="a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129" exitCode=0
Sep 11 16:29:11.166747 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:11.166411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" event={"ID":"b2803582-6801-4626-ba78-8602e53bb230","Type":"ContainerDied","Data":"a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"}
Sep 11 16:29:11.166987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:11.166971    2557 scope.go:117] "RemoveContainer" containerID="a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"
Sep 11 16:29:11.168303 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:11.168273    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:29:11.168410 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:11.168341    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:29:11.168410 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:11.168373    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:29:12.173580 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:12.173539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" event={"ID":"b2803582-6801-4626-ba78-8602e53bb230","Type":"ContainerStarted","Data":"7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0"}
Sep 11 16:29:12.257634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:12.257593    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:29:12.257904 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:12.257877    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:29:12.257955 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:12.257933    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 16:29:13.258104 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:13.258034    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:29:13.258630 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:13.258128    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 16:29:14.258346 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:14.258306    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:29:14.259385 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:14.258927    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 16:29:15.258592 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:15.258549    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:29:15.259211 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:15.259173    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 16:29:16.258553 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:16.258511    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:29:16.258770 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:16.258584    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 16:29:17.258312 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:17.258271    2557 patch_prober.go:28] interesting pod/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:29:17.258606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:17.258574    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 11 16:29:18.262208 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:18.262179    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:29:18.262655 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:18.262460    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:29:18.263284 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:29:18.263264    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:30:00.170285 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.170245    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"]
Sep 11 16:30:00.174011 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.173991    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"
Sep 11 16:30:00.178756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.178732    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:30:00.181551 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.181440    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"]
Sep 11 16:30:00.184401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.184378    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"
Sep 11 16:30:00.184896 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.184879    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"]
Sep 11 16:30:00.185005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.184989    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"
Sep 11 16:30:00.188097 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.188081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"
Sep 11 16:30:00.196570 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.196551    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"
Sep 11 16:30:00.196718 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.196698    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"]
Sep 11 16:30:00.200140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.200121    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"
Sep 11 16:30:00.202658 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.202614    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"]
Sep 11 16:30:00.205777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.205719    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"]
Sep 11 16:30:00.211726 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.211697    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"]
Sep 11 16:30:00.213006 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.212981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"]
Sep 11 16:30:00.246018 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.245960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"
Sep 11 16:30:00.257362 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.255601    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"
Sep 11 16:30:00.483449 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.483426    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"]
Sep 11 16:30:00.485463 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:30:00.485439    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff47837_4fdd_4825_adc8_9592f654b018.slice/crio-0c9ff894a7ad65e703f3a962658dafc82ce252b4fc336e377d614bf6417036e6 WatchSource:0}: Error finding container 0c9ff894a7ad65e703f3a962658dafc82ce252b4fc336e377d614bf6417036e6: Status 404 returned error can't find the container with id 0c9ff894a7ad65e703f3a962658dafc82ce252b4fc336e377d614bf6417036e6
Sep 11 16:30:00.517865 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.517838    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"]
Sep 11 16:30:00.525165 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:30:00.525137    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf349394b_9d24_46b4_81a6_fa4bc11465df.slice/crio-a70b224a4cd2d99795d83e9bc8b5b78f7550e10d41270d056b03000ab7bd07c9 WatchSource:0}: Error finding container a70b224a4cd2d99795d83e9bc8b5b78f7550e10d41270d056b03000ab7bd07c9: Status 404 returned error can't find the container with id a70b224a4cd2d99795d83e9bc8b5b78f7550e10d41270d056b03000ab7bd07c9
Sep 11 16:30:00.553032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.553003    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"]
Sep 11 16:30:00.556464 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:30:00.556425    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d7dc56_4a37_4d5e_a48f_f0224122718c.slice/crio-f1a8540fc8894203a146d4b543d385e2625105717cc06dbdda7756d8b5bc9dae WatchSource:0}: Error finding container f1a8540fc8894203a146d4b543d385e2625105717cc06dbdda7756d8b5bc9dae: Status 404 returned error can't find the container with id f1a8540fc8894203a146d4b543d385e2625105717cc06dbdda7756d8b5bc9dae
Sep 11 16:30:00.573605 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.573574    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"]
Sep 11 16:30:00.574836 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:30:00.574811    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e09b6fc_f69d_4b24_9c4c_99f01d8985f7.slice/crio-6df4f71af32fedc8000e3b527c851eaf73bcf27106153aa819e2956a241ad55a WatchSource:0}: Error finding container 6df4f71af32fedc8000e3b527c851eaf73bcf27106153aa819e2956a241ad55a: Status 404 returned error can't find the container with id 6df4f71af32fedc8000e3b527c851eaf73bcf27106153aa819e2956a241ad55a
Sep 11 16:30:00.617347 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:00.617321    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sgpws_04eac8d5-8c67-44e5-9b04-44f2c7693dac/payload-processing/0.log"
Sep 11 16:30:01.432588 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.432546    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw" event={"ID":"8e09b6fc-f69d-4b24-9c4c-99f01d8985f7","Type":"ContainerStarted","Data":"8b3775dc41e06e3df89de9009aa10274df42a1c7cf9dd81751862cae0b37311a"}
Sep 11 16:30:01.432996 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.432638    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw" event={"ID":"8e09b6fc-f69d-4b24-9c4c-99f01d8985f7","Type":"ContainerStarted","Data":"6df4f71af32fedc8000e3b527c851eaf73bcf27106153aa819e2956a241ad55a"}
Sep 11 16:30:01.434152 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.434127    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r" event={"ID":"f8d7dc56-4a37-4d5e-a48f-f0224122718c","Type":"ContainerStarted","Data":"ed476e4e35d9fc859813c74e25868559d2d6b1149db794536d10c0a14a075f8f"}
Sep 11 16:30:01.434285 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.434171    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r" event={"ID":"f8d7dc56-4a37-4d5e-a48f-f0224122718c","Type":"ContainerStarted","Data":"f1a8540fc8894203a146d4b543d385e2625105717cc06dbdda7756d8b5bc9dae"}
Sep 11 16:30:01.435588 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.435567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr" event={"ID":"f349394b-9d24-46b4-81a6-fa4bc11465df","Type":"ContainerStarted","Data":"d23ea2d55553e1b1bbb41377be7e48c1202f2bdae311d0d1b9aa72746fb3e1b4"}
Sep 11 16:30:01.435685 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.435612    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr" event={"ID":"f349394b-9d24-46b4-81a6-fa4bc11465df","Type":"ContainerStarted","Data":"a70b224a4cd2d99795d83e9bc8b5b78f7550e10d41270d056b03000ab7bd07c9"}
Sep 11 16:30:01.437053 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.437022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x" event={"ID":"5ff47837-4fdd-4825-adc8-9592f654b018","Type":"ContainerStarted","Data":"0a679aab562a4d65141ca3f9db4ad75055c919b84a67566e1e56048d8d0e3a8f"}
Sep 11 16:30:01.437144 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.437080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x" event={"ID":"5ff47837-4fdd-4825-adc8-9592f654b018","Type":"ContainerStarted","Data":"0c9ff894a7ad65e703f3a962658dafc82ce252b4fc336e377d614bf6417036e6"}
Sep 11 16:30:01.450073 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.450009    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw" podStartSLOduration=1.449993146 podStartE2EDuration="1.449993146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:01.44737511 +0000 UTC m=+1664.997562964" watchObservedRunningTime="2026-09-11 16:30:01.449993146 +0000 UTC m=+1665.000181045"
Sep 11 16:30:01.463467 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.463418    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x" podStartSLOduration=1.4634008170000001 podStartE2EDuration="1.463400817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:01.461309789 +0000 UTC m=+1665.011497642" watchObservedRunningTime="2026-09-11 16:30:01.463400817 +0000 UTC m=+1665.013588716"
Sep 11 16:30:01.477259 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.477208    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr" podStartSLOduration=1.477192435 podStartE2EDuration="1.477192435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:01.475342784 +0000 UTC m=+1665.025530637" watchObservedRunningTime="2026-09-11 16:30:01.477192435 +0000 UTC m=+1665.027380287"
Sep 11 16:30:01.490430 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:01.490221    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r" podStartSLOduration=1.490197915 podStartE2EDuration="1.490197915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:01.489434861 +0000 UTC m=+1665.039622715" watchObservedRunningTime="2026-09-11 16:30:01.490197915 +0000 UTC m=+1665.040385768"
Sep 11 16:30:02.444491 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.444455    2557 generic.go:356] "Generic (PLEG): container finished" podID="8e09b6fc-f69d-4b24-9c4c-99f01d8985f7" containerID="8b3775dc41e06e3df89de9009aa10274df42a1c7cf9dd81751862cae0b37311a" exitCode=0
Sep 11 16:30:02.444884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.444538    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw" event={"ID":"8e09b6fc-f69d-4b24-9c4c-99f01d8985f7","Type":"ContainerDied","Data":"8b3775dc41e06e3df89de9009aa10274df42a1c7cf9dd81751862cae0b37311a"}
Sep 11 16:30:02.446165 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.446142    2557 generic.go:356] "Generic (PLEG): container finished" podID="f8d7dc56-4a37-4d5e-a48f-f0224122718c" containerID="ed476e4e35d9fc859813c74e25868559d2d6b1149db794536d10c0a14a075f8f" exitCode=0
Sep 11 16:30:02.446263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.446223    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r" event={"ID":"f8d7dc56-4a37-4d5e-a48f-f0224122718c","Type":"ContainerDied","Data":"ed476e4e35d9fc859813c74e25868559d2d6b1149db794536d10c0a14a075f8f"}
Sep 11 16:30:02.447710 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.447688    2557 generic.go:356] "Generic (PLEG): container finished" podID="f349394b-9d24-46b4-81a6-fa4bc11465df" containerID="d23ea2d55553e1b1bbb41377be7e48c1202f2bdae311d0d1b9aa72746fb3e1b4" exitCode=0
Sep 11 16:30:02.447807 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.447756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr" event={"ID":"f349394b-9d24-46b4-81a6-fa4bc11465df","Type":"ContainerDied","Data":"d23ea2d55553e1b1bbb41377be7e48c1202f2bdae311d0d1b9aa72746fb3e1b4"}
Sep 11 16:30:02.449205 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.449187    2557 generic.go:356] "Generic (PLEG): container finished" podID="5ff47837-4fdd-4825-adc8-9592f654b018" containerID="0a679aab562a4d65141ca3f9db4ad75055c919b84a67566e1e56048d8d0e3a8f" exitCode=0
Sep 11 16:30:02.449288 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:02.449224    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x" event={"ID":"5ff47837-4fdd-4825-adc8-9592f654b018","Type":"ContainerDied","Data":"0a679aab562a4d65141ca3f9db4ad75055c919b84a67566e1e56048d8d0e3a8f"}
Sep 11 16:30:03.603237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:03.602814    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"
Sep 11 16:30:03.660436 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:03.660404    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"
Sep 11 16:30:03.670252 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:03.670227    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"
Sep 11 16:30:03.673258 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:03.673238    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"
Sep 11 16:30:04.460812 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.460780    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"
Sep 11 16:30:04.460812 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.460800    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr" event={"ID":"f349394b-9d24-46b4-81a6-fa4bc11465df","Type":"ContainerDied","Data":"a70b224a4cd2d99795d83e9bc8b5b78f7550e10d41270d056b03000ab7bd07c9"}
Sep 11 16:30:04.461071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.460858    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a70b224a4cd2d99795d83e9bc8b5b78f7550e10d41270d056b03000ab7bd07c9"
Sep 11 16:30:04.462280 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.462245    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x"
Sep 11 16:30:04.462420 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.462281    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819070-h5p8x" event={"ID":"5ff47837-4fdd-4825-adc8-9592f654b018","Type":"ContainerDied","Data":"0c9ff894a7ad65e703f3a962658dafc82ce252b4fc336e377d614bf6417036e6"}
Sep 11 16:30:04.462420 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.462328    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c9ff894a7ad65e703f3a962658dafc82ce252b4fc336e377d614bf6417036e6"
Sep 11 16:30:04.463819 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.463793    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw" event={"ID":"8e09b6fc-f69d-4b24-9c4c-99f01d8985f7","Type":"ContainerDied","Data":"6df4f71af32fedc8000e3b527c851eaf73bcf27106153aa819e2956a241ad55a"}
Sep 11 16:30:04.463946 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.463845    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6df4f71af32fedc8000e3b527c851eaf73bcf27106153aa819e2956a241ad55a"
Sep 11 16:30:04.463946 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.463800    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"
Sep 11 16:30:04.465280 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.465252    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"
Sep 11 16:30:04.465404 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.465251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r" event={"ID":"f8d7dc56-4a37-4d5e-a48f-f0224122718c","Type":"ContainerDied","Data":"f1a8540fc8894203a146d4b543d385e2625105717cc06dbdda7756d8b5bc9dae"}
Sep 11 16:30:04.465404 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:04.465382    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1a8540fc8894203a146d4b543d385e2625105717cc06dbdda7756d8b5bc9dae"
Sep 11 16:30:17.130365 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:17.130321    2557 scope.go:117] "RemoveContainer" containerID="0c9a056734d15ec616d59b4d3bfe7f59394aa42bc3c399500edd8a7f28913d14"
Sep 11 16:30:46.548913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:46.548823    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb_fc6fe997-2fad-4986-a528-939d6e55715f/payload-processing/0.log"
Sep 11 16:30:46.671957 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:46.671928    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sgpws_04eac8d5-8c67-44e5-9b04-44f2c7693dac/payload-processing/0.log"
Sep 11 16:30:47.396506 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396470    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"]
Sep 11 16:30:47.396898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396886    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e09b6fc-f69d-4b24-9c4c-99f01d8985f7" containerName="cleanup"
Sep 11 16:30:47.396940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396899    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e09b6fc-f69d-4b24-9c4c-99f01d8985f7" containerName="cleanup"
Sep 11 16:30:47.396940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396914    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff47837-4fdd-4825-adc8-9592f654b018" containerName="cleanup"
Sep 11 16:30:47.396940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396920    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff47837-4fdd-4825-adc8-9592f654b018" containerName="cleanup"
Sep 11 16:30:47.396940 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396938    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8d7dc56-4a37-4d5e-a48f-f0224122718c" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396944    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8d7dc56-4a37-4d5e-a48f-f0224122718c" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396950    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f349394b-9d24-46b4-81a6-fa4bc11465df" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.396954    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f349394b-9d24-46b4-81a6-fa4bc11465df" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.397021    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e09b6fc-f69d-4b24-9c4c-99f01d8985f7" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.397028    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8d7dc56-4a37-4d5e-a48f-f0224122718c" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.397036    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff47837-4fdd-4825-adc8-9592f654b018" containerName="cleanup"
Sep 11 16:30:47.397086 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.397060    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f349394b-9d24-46b4-81a6-fa4bc11465df" containerName="cleanup"
Sep 11 16:30:47.401325 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.401303    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.404921 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.404898    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-4b91c4-openshift-default-dockercfg-f8cll\""
Sep 11 16:30:47.425277 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.425242    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"]
Sep 11 16:30:47.553087 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553030    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-credential-socket\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553087 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-socket\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553206    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-certs\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-envoy\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-data\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-token\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553384    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b69qv\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-kube-api-access-b69qv\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.553597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.553425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-podinfo\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.654964 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.654855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-credential-socket\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.654964 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.654901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-socket\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.654964 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.654925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.654964 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.654964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-certs\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.654987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-envoy\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-data\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655125    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-token\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655175    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b69qv\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-kube-api-access-b69qv\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655351 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-podinfo\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-credential-socket\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655414    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-certs\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655600 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655435    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-socket\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655782 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-data\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.655890 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.655799    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istiod-ca-cert\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.657709 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.657678    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-podinfo\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.657801 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.657687    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-envoy\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.664107 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.664082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-token\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.664193 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.664166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b69qv\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-kube-api-access-b69qv\") pod \"e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") " pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.711981 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.711945    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:47.998971 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:47.998941    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"]
Sep 11 16:30:48.000476 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:30:48.000432    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4d7605_91ef_4398_9ccd_bf766b499ed9.slice/crio-86f346000b0d684c9dc4cee3924734bd1fd30a6e5545b2bb0f6519fa9dc11cc5 WatchSource:0}: Error finding container 86f346000b0d684c9dc4cee3924734bd1fd30a6e5545b2bb0f6519fa9dc11cc5: Status 404 returned error can't find the container with id 86f346000b0d684c9dc4cee3924734bd1fd30a6e5545b2bb0f6519fa9dc11cc5
Sep 11 16:30:48.003109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:48.003069    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:30:48.003197 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:48.003165    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:30:48.003237 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:48.003203    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:30:48.704533 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:48.704496    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" event={"ID":"bb4d7605-91ef-4398-9ccd-bf766b499ed9","Type":"ContainerStarted","Data":"7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"}
Sep 11 16:30:48.704930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:48.704554    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" event={"ID":"bb4d7605-91ef-4398-9ccd-bf766b499ed9","Type":"ContainerStarted","Data":"86f346000b0d684c9dc4cee3924734bd1fd30a6e5545b2bb0f6519fa9dc11cc5"}
Sep 11 16:30:48.712889 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:48.712857    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:49.718571 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:49.718535    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:50.116627 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:50.116570    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podStartSLOduration=3.116552954 podStartE2EDuration="3.116552954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:50.113219 +0000 UTC m=+1713.663406852" watchObservedRunningTime="2026-09-11 16:30:50.116552954 +0000 UTC m=+1713.666740806"
Sep 11 16:30:50.715815 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:50.715779    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:30:50.716913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:30:50.716891    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:31:14.641872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.641836    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"]
Sep 11 16:31:14.645752 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.645733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.648360 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.648336    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-4b91c4\""
Sep 11 16:31:14.648481 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.648371    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-4b91c4-dockercfg-nksvm\""
Sep 11 16:31:14.657611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.657582    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"]
Sep 11 16:31:14.734439 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.734394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26swz\" (UniqueName: \"kubernetes.io/projected/6e4b4fbf-7282-481c-bd06-a6af79dd118f-kube-api-access-26swz\") pod \"payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.734439 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.734447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e4b4fbf-7282-481c-bd06-a6af79dd118f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.835877 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.835835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26swz\" (UniqueName: \"kubernetes.io/projected/6e4b4fbf-7282-481c-bd06-a6af79dd118f-kube-api-access-26swz\") pod \"payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.836102 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.835891    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e4b4fbf-7282-481c-bd06-a6af79dd118f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.836872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.836845    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e4b4fbf-7282-481c-bd06-a6af79dd118f-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.845345 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.845317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26swz\" (UniqueName: \"kubernetes.io/projected/6e4b4fbf-7282-481c-bd06-a6af79dd118f-kube-api-access-26swz\") pod \"payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:14.957520 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:14.957435    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:15.233027 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:15.232994    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"]
Sep 11 16:31:15.234591 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:31:15.234566    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4b4fbf_7282_481c_bd06_a6af79dd118f.slice/crio-2505a37ef10d8e9042e2f980c308571478df9341b791d28826118fbae3e19ed4 WatchSource:0}: Error finding container 2505a37ef10d8e9042e2f980c308571478df9341b791d28826118fbae3e19ed4: Status 404 returned error can't find the container with id 2505a37ef10d8e9042e2f980c308571478df9341b791d28826118fbae3e19ed4
Sep 11 16:31:15.855247 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:15.855210    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf" event={"ID":"6e4b4fbf-7282-481c-bd06-a6af79dd118f","Type":"ContainerStarted","Data":"302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e"}
Sep 11 16:31:15.855634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:15.855271    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:15.855634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:15.855288    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf" event={"ID":"6e4b4fbf-7282-481c-bd06-a6af79dd118f","Type":"ContainerStarted","Data":"2505a37ef10d8e9042e2f980c308571478df9341b791d28826118fbae3e19ed4"}
Sep 11 16:31:15.872774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:15.872692    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf" podStartSLOduration=1.87267501 podStartE2EDuration="1.87267501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:15.871901074 +0000 UTC m=+1739.422088931" watchObservedRunningTime="2026-09-11 16:31:15.87267501 +0000 UTC m=+1739.422862862"
Sep 11 16:31:26.863533 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:26.863498    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:29.938795 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:29.938716    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerID="7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd" exitCode=0
Sep 11 16:31:29.939199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:29.938789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" event={"ID":"bb4d7605-91ef-4398-9ccd-bf766b499ed9","Type":"ContainerDied","Data":"7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"}
Sep 11 16:31:29.939332 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:29.939314    2557 scope.go:117] "RemoveContainer" containerID="7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"
Sep 11 16:31:29.940610 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:29.940579    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:31:29.940668 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:29.940656    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:31:29.940714 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:29.940703    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:31:30.946323 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:30.946287    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" event={"ID":"bb4d7605-91ef-4398-9ccd-bf766b499ed9","Type":"ContainerStarted","Data":"5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7"}
Sep 11 16:31:31.712232 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:31.712183    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:31:31.713608 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:31.713577    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 16:31:31.713716 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:31.713629    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 16:31:32.712755 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:32.712719    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 16:31:32.713166 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:32.712784    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 16:31:33.713003 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:33.712961    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 16:31:33.713417 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:33.713028    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 16:31:34.712785 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:34.712742    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 16:31:34.712977 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:34.712806    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 16:31:35.712850 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:35.712814    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 16:31:35.713259 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:35.712871    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 16:31:35.716619 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:35.716596    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:31:36.713038 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:36.712998    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 11 16:31:36.713451 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:36.713078    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 11 16:31:37.716965 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:37.716930    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:31:37.717978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:37.717957    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:31:42.433671 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.433630    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"]
Sep 11 16:31:42.437617 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.437591    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:42.440314 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.440291    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:31:42.440464 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.440446    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:31:42.447925 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.447875    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"]
Sep 11 16:31:42.540874 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.540826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/851b1992-27a2-4291-a179-487ea28dfb6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w\" (UID: \"851b1992-27a2-4291-a179-487ea28dfb6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:42.642559 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.642514    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/851b1992-27a2-4291-a179-487ea28dfb6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w\" (UID: \"851b1992-27a2-4291-a179-487ea28dfb6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:42.643164 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.643142    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/851b1992-27a2-4291-a179-487ea28dfb6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w\" (UID: \"851b1992-27a2-4291-a179-487ea28dfb6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:42.749958 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:42.749860    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:43.042269 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:43.042234    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"]
Sep 11 16:31:43.044235 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:31:43.044203    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851b1992_27a2_4291_a179_487ea28dfb6b.slice/crio-d72bdfa6d7ca189653485416a288ad7a7baebfc19d9d49154a1a3ec8caec4707 WatchSource:0}: Error finding container d72bdfa6d7ca189653485416a288ad7a7baebfc19d9d49154a1a3ec8caec4707: Status 404 returned error can't find the container with id d72bdfa6d7ca189653485416a288ad7a7baebfc19d9d49154a1a3ec8caec4707
Sep 11 16:31:44.035814 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:44.035713    2557 generic.go:356] "Generic (PLEG): container finished" podID="851b1992-27a2-4291-a179-487ea28dfb6b" containerID="6731c933a5593207c379b195d0401cf92fc8ad476267801cde526aed59543e3d" exitCode=0
Sep 11 16:31:44.036247 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:44.035805    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w" event={"ID":"851b1992-27a2-4291-a179-487ea28dfb6b","Type":"ContainerDied","Data":"6731c933a5593207c379b195d0401cf92fc8ad476267801cde526aed59543e3d"}
Sep 11 16:31:44.036247 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:44.035887    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w" event={"ID":"851b1992-27a2-4291-a179-487ea28dfb6b","Type":"ContainerStarted","Data":"d72bdfa6d7ca189653485416a288ad7a7baebfc19d9d49154a1a3ec8caec4707"}
Sep 11 16:31:45.172773 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:45.172747    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:45.270396 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:45.270355    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/851b1992-27a2-4291-a179-487ea28dfb6b-maas-api-service-ca\") pod \"851b1992-27a2-4291-a179-487ea28dfb6b\" (UID: \"851b1992-27a2-4291-a179-487ea28dfb6b\") "
Sep 11 16:31:45.270797 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:45.270770    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/851b1992-27a2-4291-a179-487ea28dfb6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "851b1992-27a2-4291-a179-487ea28dfb6b" (UID: "851b1992-27a2-4291-a179-487ea28dfb6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:31:45.372189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:45.372153    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/851b1992-27a2-4291-a179-487ea28dfb6b-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:31:46.048292 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:46.048261    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"
Sep 11 16:31:46.048292 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:46.048283    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w" event={"ID":"851b1992-27a2-4291-a179-487ea28dfb6b","Type":"ContainerDied","Data":"d72bdfa6d7ca189653485416a288ad7a7baebfc19d9d49154a1a3ec8caec4707"}
Sep 11 16:31:46.048516 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:46.048324    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d72bdfa6d7ca189653485416a288ad7a7baebfc19d9d49154a1a3ec8caec4707"
Sep 11 16:31:53.181917 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.181828    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"]
Sep 11 16:31:53.182387 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.182072    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf" podUID="6e4b4fbf-7282-481c-bd06-a6af79dd118f" containerName="payload-pre-processing" containerID="cri-o://302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e" gracePeriod=30
Sep 11 16:31:53.414397 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.414346    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"]
Sep 11 16:31:53.428072 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.426439    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-4b91c4-v5b9w"]
Sep 11 16:31:53.464189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.464163    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:53.467735 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.467710    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26swz\" (UniqueName: \"kubernetes.io/projected/6e4b4fbf-7282-481c-bd06-a6af79dd118f-kube-api-access-26swz\") pod \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") "
Sep 11 16:31:53.467884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.467771    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e4b4fbf-7282-481c-bd06-a6af79dd118f-plugins-config-volume\") pod \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\" (UID: \"6e4b4fbf-7282-481c-bd06-a6af79dd118f\") "
Sep 11 16:31:53.468263 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.468230    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e4b4fbf-7282-481c-bd06-a6af79dd118f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e4b4fbf-7282-481c-bd06-a6af79dd118f" (UID: "6e4b4fbf-7282-481c-bd06-a6af79dd118f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:31:53.470014 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.469979    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4b4fbf-7282-481c-bd06-a6af79dd118f-kube-api-access-26swz" (OuterVolumeSpecName: "kube-api-access-26swz") pod "6e4b4fbf-7282-481c-bd06-a6af79dd118f" (UID: "6e4b4fbf-7282-481c-bd06-a6af79dd118f"). InnerVolumeSpecName "kube-api-access-26swz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:31:53.568640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.568598    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26swz\" (UniqueName: \"kubernetes.io/projected/6e4b4fbf-7282-481c-bd06-a6af79dd118f-kube-api-access-26swz\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:31:53.568640 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:53.568633    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e4b4fbf-7282-481c-bd06-a6af79dd118f-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:31:54.095075 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.095009    2557 generic.go:356] "Generic (PLEG): container finished" podID="6e4b4fbf-7282-481c-bd06-a6af79dd118f" containerID="302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e" exitCode=0
Sep 11 16:31:54.095239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.095081    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"
Sep 11 16:31:54.095239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.095090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf" event={"ID":"6e4b4fbf-7282-481c-bd06-a6af79dd118f","Type":"ContainerDied","Data":"302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e"}
Sep 11 16:31:54.095239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.095157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf" event={"ID":"6e4b4fbf-7282-481c-bd06-a6af79dd118f","Type":"ContainerDied","Data":"2505a37ef10d8e9042e2f980c308571478df9341b791d28826118fbae3e19ed4"}
Sep 11 16:31:54.095239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.095180    2557 scope.go:117] "RemoveContainer" containerID="302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e"
Sep 11 16:31:54.104611 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.104587    2557 scope.go:117] "RemoveContainer" containerID="302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e"
Sep 11 16:31:54.104911 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:31:54.104890    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e\": container with ID starting with 302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e not found: ID does not exist" containerID="302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e"
Sep 11 16:31:54.104984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.104920    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e"} err="failed to get container status \"302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e\": rpc error: code = NotFound desc = could not find container \"302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e\": container with ID starting with 302592c7a6c77246a12e7762e54063c042abeb444ac37e91bf9d2a6d1a29ff7e not found: ID does not exist"
Sep 11 16:31:54.119809 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.119777    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"]
Sep 11 16:31:54.126989 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.126960    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-4b91c4-547f4cc7cd-j6kmf"]
Sep 11 16:31:54.893287 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.893251    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4b4fbf-7282-481c-bd06-a6af79dd118f" path="/var/lib/kubelet/pods/6e4b4fbf-7282-481c-bd06-a6af79dd118f/volumes"
Sep 11 16:31:54.893667 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:31:54.893578    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="851b1992-27a2-4291-a179-487ea28dfb6b" path="/var/lib/kubelet/pods/851b1992-27a2-4291-a179-487ea28dfb6b/volumes"
Sep 11 16:32:00.418950 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:00.418915    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"]
Sep 11 16:32:00.419485 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:00.419168    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy" containerID="cri-o://5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7" gracePeriod=30
Sep 11 16:32:03.973390 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973351    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"]
Sep 11 16:32:03.973800 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973786    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4b4fbf-7282-481c-bd06-a6af79dd118f" containerName="payload-pre-processing"
Sep 11 16:32:03.973849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973804    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4b4fbf-7282-481c-bd06-a6af79dd118f" containerName="payload-pre-processing"
Sep 11 16:32:03.973849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973816    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851b1992-27a2-4291-a179-487ea28dfb6b" containerName="revoke-keys"
Sep 11 16:32:03.973849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973823    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="851b1992-27a2-4291-a179-487ea28dfb6b" containerName="revoke-keys"
Sep 11 16:32:03.973945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973879    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="851b1992-27a2-4291-a179-487ea28dfb6b" containerName="revoke-keys"
Sep 11 16:32:03.973945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.973890    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e4b4fbf-7282-481c-bd06-a6af79dd118f" containerName="payload-pre-processing"
Sep 11 16:32:03.978299 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.978278    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:03.982401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.982374    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:32:03.982693 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.982672    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:32:03.999145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:03.999117    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"]
Sep 11 16:32:04.076613 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:04.076578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee9dff4-0daf-47c5-963b-8fc4e13762aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87\" (UID: \"5ee9dff4-0daf-47c5-963b-8fc4e13762aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:04.177336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:04.177302    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee9dff4-0daf-47c5-963b-8fc4e13762aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87\" (UID: \"5ee9dff4-0daf-47c5-963b-8fc4e13762aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:04.177933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:04.177913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee9dff4-0daf-47c5-963b-8fc4e13762aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87\" (UID: \"5ee9dff4-0daf-47c5-963b-8fc4e13762aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:04.289336 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:04.289256    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:04.570566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:04.570535    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"]
Sep 11 16:32:04.573277 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:32:04.573245    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee9dff4_0daf_47c5_963b_8fc4e13762aa.slice/crio-d5a43a172629c10b85a7fb4d7eaa2cba461f89c2454b247c5f8531663c843490 WatchSource:0}: Error finding container d5a43a172629c10b85a7fb4d7eaa2cba461f89c2454b247c5f8531663c843490: Status 404 returned error can't find the container with id d5a43a172629c10b85a7fb4d7eaa2cba461f89c2454b247c5f8531663c843490
Sep 11 16:32:05.174566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.174467    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87" event={"ID":"5ee9dff4-0daf-47c5-963b-8fc4e13762aa","Type":"ContainerStarted","Data":"4a7eae4f34639fea418e4bc676e166a87feaf81aeaa38a5063663519a762c775"}
Sep 11 16:32:05.174566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.174529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87" event={"ID":"5ee9dff4-0daf-47c5-963b-8fc4e13762aa","Type":"ContainerStarted","Data":"d5a43a172629c10b85a7fb4d7eaa2cba461f89c2454b247c5f8531663c843490"}
Sep 11 16:32:05.192849 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.192794    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87" podStartSLOduration=2.192774579 podStartE2EDuration="2.192774579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:32:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:05.191164851 +0000 UTC m=+1788.741352706" watchObservedRunningTime="2026-09-11 16:32:05.192774579 +0000 UTC m=+1788.742962430"
Sep 11 16:32:05.673275 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.673250    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:32:05.794257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794177    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istiod-ca-cert\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794257 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794222    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-credential-socket\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794262    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b69qv\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-kube-api-access-b69qv\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794370    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-data\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794416    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-envoy\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794446    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-socket\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794488 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794489    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-certs\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794515    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-podinfo\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794563    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:05.794742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794615    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-token\") pod \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\" (UID: \"bb4d7605-91ef-4398-9ccd-bf766b499ed9\") "
Sep 11 16:32:05.794742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794657    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:05.794742 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794722    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:05.795017 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794737    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:05.795017 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.794906    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:05.795173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.795023    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.795173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.795075    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.795173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.795094    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.795173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.795107    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.795173 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.795119    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.796514 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.796489    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-kube-api-access-b69qv" (OuterVolumeSpecName: "kube-api-access-b69qv") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "kube-api-access-b69qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:05.796632 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.796593    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:32:05.796700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.796647    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:05.796756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.796719    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb4d7605-91ef-4398-9ccd-bf766b499ed9" (UID: "bb4d7605-91ef-4398-9ccd-bf766b499ed9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:05.896507 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.896460    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b69qv\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-kube-api-access-b69qv\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.896507 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.896496    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.896507 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.896506    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:05.896507 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:05.896513    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb4d7605-91ef-4398-9ccd-bf766b499ed9-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:06.181495 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.181455    2557 generic.go:356] "Generic (PLEG): container finished" podID="5ee9dff4-0daf-47c5-963b-8fc4e13762aa" containerID="4a7eae4f34639fea418e4bc676e166a87feaf81aeaa38a5063663519a762c775" exitCode=0
Sep 11 16:32:06.181914 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.181538    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87" event={"ID":"5ee9dff4-0daf-47c5-963b-8fc4e13762aa","Type":"ContainerDied","Data":"4a7eae4f34639fea418e4bc676e166a87feaf81aeaa38a5063663519a762c775"}
Sep 11 16:32:06.183239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.183211    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerID="5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7" exitCode=0
Sep 11 16:32:06.183374 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.183267    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"
Sep 11 16:32:06.183374 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.183286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" event={"ID":"bb4d7605-91ef-4398-9ccd-bf766b499ed9","Type":"ContainerDied","Data":"5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7"}
Sep 11 16:32:06.183374 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.183341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25" event={"ID":"bb4d7605-91ef-4398-9ccd-bf766b499ed9","Type":"ContainerDied","Data":"86f346000b0d684c9dc4cee3924734bd1fd30a6e5545b2bb0f6519fa9dc11cc5"}
Sep 11 16:32:06.183374 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.183369    2557 scope.go:117] "RemoveContainer" containerID="5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7"
Sep 11 16:32:06.193674 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.193651    2557 scope.go:117] "RemoveContainer" containerID="7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"
Sep 11 16:32:06.202863 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.202843    2557 scope.go:117] "RemoveContainer" containerID="5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7"
Sep 11 16:32:06.203185 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:32:06.203162    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7\": container with ID starting with 5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7 not found: ID does not exist" containerID="5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7"
Sep 11 16:32:06.203253 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.203197    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7"} err="failed to get container status \"5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7\": rpc error: code = NotFound desc = could not find container \"5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7\": container with ID starting with 5b45b371534518d6f2e4c0a6dfbe3b01ee2f186e076f0eb7ab25bb665aee6ad7 not found: ID does not exist"
Sep 11 16:32:06.203253 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.203216    2557 scope.go:117] "RemoveContainer" containerID="7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"
Sep 11 16:32:06.203527 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:32:06.203507    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd\": container with ID starting with 7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd not found: ID does not exist" containerID="7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"
Sep 11 16:32:06.203594 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.203539    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd"} err="failed to get container status \"7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd\": rpc error: code = NotFound desc = could not find container \"7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd\": container with ID starting with 7e01eca0415bf95b6d90b6877d2ad460f2bf3d30b60f2abc7d25538b570113cd not found: ID does not exist"
Sep 11 16:32:06.213555 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.213519    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"]
Sep 11 16:32:06.218821 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.218791    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-4b91c4-openshift-default-5f7546b454-wxq25"]
Sep 11 16:32:06.893579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:06.893548    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" path="/var/lib/kubelet/pods/bb4d7605-91ef-4398-9ccd-bf766b499ed9/volumes"
Sep 11 16:32:07.326446 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:07.326421    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:07.413551 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:07.413509    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee9dff4-0daf-47c5-963b-8fc4e13762aa-maas-api-service-ca\") pod \"5ee9dff4-0daf-47c5-963b-8fc4e13762aa\" (UID: \"5ee9dff4-0daf-47c5-963b-8fc4e13762aa\") "
Sep 11 16:32:07.413935 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:07.413902    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ee9dff4-0daf-47c5-963b-8fc4e13762aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ee9dff4-0daf-47c5-963b-8fc4e13762aa" (UID: "5ee9dff4-0daf-47c5-963b-8fc4e13762aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:07.515369 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:07.515266    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ee9dff4-0daf-47c5-963b-8fc4e13762aa-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:08.196812 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:08.196785    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"
Sep 11 16:32:08.197026 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:08.196785    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87" event={"ID":"5ee9dff4-0daf-47c5-963b-8fc4e13762aa","Type":"ContainerDied","Data":"d5a43a172629c10b85a7fb4d7eaa2cba461f89c2454b247c5f8531663c843490"}
Sep 11 16:32:08.197026 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:08.196903    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5a43a172629c10b85a7fb4d7eaa2cba461f89c2454b247c5f8531663c843490"
Sep 11 16:32:16.953726 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:16.953694    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:32:16.957338 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:16.957315    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:32:17.162153 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:17.162123    2557 scope.go:117] "RemoveContainer" containerID="31647e1121bc2023b88cfe59cd17355fbdf7e04cbc54280e418e1c486bf2c8c3"
Sep 11 16:32:19.964977 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:19.964941    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"]
Sep 11 16:32:19.965422 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:19.965199    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" podUID="fc6fe997-2fad-4986-a528-939d6e55715f" containerName="payload-processing" containerID="cri-o://1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b" gracePeriod=30
Sep 11 16:32:19.975378 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:19.975349    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"]
Sep 11 16:32:19.975615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:19.975570    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" podUID="21342c6e-6de4-4c52-a840-fcb966f9119b" containerName="payload-pre-processing" containerID="cri-o://25d2a46ab0f83b00f7d859fbc441c3626f5dab71aeb334ed195c8e066afde3d4" gracePeriod=30
Sep 11 16:32:20.107005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.106949    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" podUID="21342c6e-6de4-4c52-a840-fcb966f9119b" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.67:9004: connect: connection refused"
Sep 11 16:32:20.107235 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.106950    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" podUID="fc6fe997-2fad-4986-a528-939d6e55715f" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.66:9004: connect: connection refused"
Sep 11 16:32:20.232985 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.232895    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"]
Sep 11 16:32:20.238770 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.238738    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-9bac29-ckt87"]
Sep 11 16:32:20.273447 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.272320    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:32:20.273616 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.273539    2557 generic.go:356] "Generic (PLEG): container finished" podID="fc6fe997-2fad-4986-a528-939d6e55715f" containerID="1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b" exitCode=0
Sep 11 16:32:20.273696 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.273642    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" event={"ID":"fc6fe997-2fad-4986-a528-939d6e55715f","Type":"ContainerDied","Data":"1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b"}
Sep 11 16:32:20.273759 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.273731    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb" event={"ID":"fc6fe997-2fad-4986-a528-939d6e55715f","Type":"ContainerDied","Data":"204d95b8e77e0424e1b29e698390d17ba5960ab507755f0a87f05150ba9e5645"}
Sep 11 16:32:20.273810 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.273765    2557 scope.go:117] "RemoveContainer" containerID="1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b"
Sep 11 16:32:20.276767 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.276728    2557 generic.go:356] "Generic (PLEG): container finished" podID="21342c6e-6de4-4c52-a840-fcb966f9119b" containerID="25d2a46ab0f83b00f7d859fbc441c3626f5dab71aeb334ed195c8e066afde3d4" exitCode=0
Sep 11 16:32:20.276945 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.276792    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" event={"ID":"21342c6e-6de4-4c52-a840-fcb966f9119b","Type":"ContainerDied","Data":"25d2a46ab0f83b00f7d859fbc441c3626f5dab71aeb334ed195c8e066afde3d4"}
Sep 11 16:32:20.277136 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.276968    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc" event={"ID":"21342c6e-6de4-4c52-a840-fcb966f9119b","Type":"ContainerDied","Data":"00456216c93634e7e6d3a7ff7ee153f75368f77640121ba2b3c5e66fa8a09103"}
Sep 11 16:32:20.277136 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.276989    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00456216c93634e7e6d3a7ff7ee153f75368f77640121ba2b3c5e66fa8a09103"
Sep 11 16:32:20.278239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.278222    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:32:20.292008 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.291975    2557 scope.go:117] "RemoveContainer" containerID="1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b"
Sep 11 16:32:20.292445 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:32:20.292424    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b\": container with ID starting with 1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b not found: ID does not exist" containerID="1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b"
Sep 11 16:32:20.292511 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.292458    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b"} err="failed to get container status \"1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b\": rpc error: code = NotFound desc = could not find container \"1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b\": container with ID starting with 1a7f48c12b5242f1abd9eda547dd2aaacc7f7593620dec441a299d64356a526b not found: ID does not exist"
Sep 11 16:32:20.450030 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.449990    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21342c6e-6de4-4c52-a840-fcb966f9119b-plugins-config-volume\") pod \"21342c6e-6de4-4c52-a840-fcb966f9119b\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") "
Sep 11 16:32:20.450201 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450104    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp27c\" (UniqueName: \"kubernetes.io/projected/fc6fe997-2fad-4986-a528-939d6e55715f-kube-api-access-xp27c\") pod \"fc6fe997-2fad-4986-a528-939d6e55715f\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") "
Sep 11 16:32:20.450201 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450131    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6fe997-2fad-4986-a528-939d6e55715f-plugins-config-volume\") pod \"fc6fe997-2fad-4986-a528-939d6e55715f\" (UID: \"fc6fe997-2fad-4986-a528-939d6e55715f\") "
Sep 11 16:32:20.450330 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450213    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqnp2\" (UniqueName: \"kubernetes.io/projected/21342c6e-6de4-4c52-a840-fcb966f9119b-kube-api-access-nqnp2\") pod \"21342c6e-6de4-4c52-a840-fcb966f9119b\" (UID: \"21342c6e-6de4-4c52-a840-fcb966f9119b\") "
Sep 11 16:32:20.450424 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450398    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21342c6e-6de4-4c52-a840-fcb966f9119b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21342c6e-6de4-4c52-a840-fcb966f9119b" (UID: "21342c6e-6de4-4c52-a840-fcb966f9119b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:20.450634 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450606    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc6fe997-2fad-4986-a528-939d6e55715f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc6fe997-2fad-4986-a528-939d6e55715f" (UID: "fc6fe997-2fad-4986-a528-939d6e55715f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:20.450777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450758    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21342c6e-6de4-4c52-a840-fcb966f9119b-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:20.450831 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.450783    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc6fe997-2fad-4986-a528-939d6e55715f-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:20.452233 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.452210    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6fe997-2fad-4986-a528-939d6e55715f-kube-api-access-xp27c" (OuterVolumeSpecName: "kube-api-access-xp27c") pod "fc6fe997-2fad-4986-a528-939d6e55715f" (UID: "fc6fe997-2fad-4986-a528-939d6e55715f"). InnerVolumeSpecName "kube-api-access-xp27c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:20.452311 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.452283    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21342c6e-6de4-4c52-a840-fcb966f9119b-kube-api-access-nqnp2" (OuterVolumeSpecName: "kube-api-access-nqnp2") pod "21342c6e-6de4-4c52-a840-fcb966f9119b" (UID: "21342c6e-6de4-4c52-a840-fcb966f9119b"). InnerVolumeSpecName "kube-api-access-nqnp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:20.551798 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.551763    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp27c\" (UniqueName: \"kubernetes.io/projected/fc6fe997-2fad-4986-a528-939d6e55715f-kube-api-access-xp27c\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:20.551798 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.551795    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqnp2\" (UniqueName: \"kubernetes.io/projected/21342c6e-6de4-4c52-a840-fcb966f9119b-kube-api-access-nqnp2\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:32:20.893361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:20.893277    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee9dff4-0daf-47c5-963b-8fc4e13762aa" path="/var/lib/kubelet/pods/5ee9dff4-0daf-47c5-963b-8fc4e13762aa/volumes"
Sep 11 16:32:21.283472 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:21.283371    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"
Sep 11 16:32:21.283952 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:21.283621    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"
Sep 11 16:32:21.303451 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:21.303418    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"]
Sep 11 16:32:21.314433 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:21.314392    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-9bac29-69989fd86b-bd2kc"]
Sep 11 16:32:21.336597 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:21.336550    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"]
Sep 11 16:32:21.340238 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:21.340212    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9bac29-586c6b5877-69zgb"]
Sep 11 16:32:22.893318 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:22.893281    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21342c6e-6de4-4c52-a840-fcb966f9119b" path="/var/lib/kubelet/pods/21342c6e-6de4-4c52-a840-fcb966f9119b/volumes"
Sep 11 16:32:22.893671 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:32:22.893655    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6fe997-2fad-4986-a528-939d6e55715f" path="/var/lib/kubelet/pods/fc6fe997-2fad-4986-a528-939d6e55715f/volumes"
Sep 11 16:33:10.973960 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:10.973918    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"]
Sep 11 16:33:10.974493 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:10.974144    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy" containerID="cri-o://7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0" gracePeriod=30
Sep 11 16:33:11.399904 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.399863    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"]
Sep 11 16:33:11.400281 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400267    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400282    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400291    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee9dff4-0daf-47c5-963b-8fc4e13762aa" containerName="revoke-keys"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400296    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee9dff4-0daf-47c5-963b-8fc4e13762aa" containerName="revoke-keys"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400305    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6fe997-2fad-4986-a528-939d6e55715f" containerName="payload-processing"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400311    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6fe997-2fad-4986-a528-939d6e55715f" containerName="payload-processing"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400317    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21342c6e-6de4-4c52-a840-fcb966f9119b" containerName="payload-pre-processing"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400322    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="21342c6e-6de4-4c52-a840-fcb966f9119b" containerName="payload-pre-processing"
Sep 11 16:33:11.400339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400340    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy"
Sep 11 16:33:11.400579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400345    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy"
Sep 11 16:33:11.400579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400408    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy"
Sep 11 16:33:11.400579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400419    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6fe997-2fad-4986-a528-939d6e55715f" containerName="payload-processing"
Sep 11 16:33:11.400579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400425    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee9dff4-0daf-47c5-963b-8fc4e13762aa" containerName="revoke-keys"
Sep 11 16:33:11.400579 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.400433    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="21342c6e-6de4-4c52-a840-fcb966f9119b" containerName="payload-pre-processing"
Sep 11 16:33:11.403880 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.403860    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:11.410735 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.410636    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:33:11.411158 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.411139    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:33:11.420995 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.420966    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"]
Sep 11 16:33:11.451113 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.451069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs\" (UID: \"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:11.551775 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.551729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs\" (UID: \"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:11.552410 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.552386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs\" (UID: \"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:11.714149 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:11.714024    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:12.012884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:12.012859    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"]
Sep 11 16:33:12.015133 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:33:12.015099    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cde0123_6fcc_4f83_8e5a_3b7e8539a4b2.slice/crio-6c3a22e49a73c895c6a26d67c0d0dfda8a3b5c49eadd4d7ee8ddd2586137069b WatchSource:0}: Error finding container 6c3a22e49a73c895c6a26d67c0d0dfda8a3b5c49eadd4d7ee8ddd2586137069b: Status 404 returned error can't find the container with id 6c3a22e49a73c895c6a26d67c0d0dfda8a3b5c49eadd4d7ee8ddd2586137069b
Sep 11 16:33:12.566100 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:12.566065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs" event={"ID":"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2","Type":"ContainerStarted","Data":"a3b58ae73197dfb7a505f1772e3d2d90b8c8b12fc81ae72cf4f40bdf55a92bd4"}
Sep 11 16:33:12.566274 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:12.566116    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs" event={"ID":"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2","Type":"ContainerStarted","Data":"6c3a22e49a73c895c6a26d67c0d0dfda8a3b5c49eadd4d7ee8ddd2586137069b"}
Sep 11 16:33:12.608453 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:12.608332    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs" podStartSLOduration=1.608311186 podStartE2EDuration="1.608311186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:33:12.608008089 +0000 UTC m=+1856.158195944" watchObservedRunningTime="2026-09-11 16:33:12.608311186 +0000 UTC m=+1856.158499038"
Sep 11 16:33:13.573217 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:13.573176    2557 generic.go:356] "Generic (PLEG): container finished" podID="6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2" containerID="a3b58ae73197dfb7a505f1772e3d2d90b8c8b12fc81ae72cf4f40bdf55a92bd4" exitCode=0
Sep 11 16:33:13.573630 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:13.573266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs" event={"ID":"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2","Type":"ContainerDied","Data":"a3b58ae73197dfb7a505f1772e3d2d90b8c8b12fc81ae72cf4f40bdf55a92bd4"}
Sep 11 16:33:14.713102 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:14.713073    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:14.787198 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:14.787163    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2-maas-api-service-ca\") pod \"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2\" (UID: \"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2\") "
Sep 11 16:33:14.787581 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:14.787560    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2" (UID: "6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:14.888978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:14.888890    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:15.585213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:15.585177    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"
Sep 11 16:33:15.585213 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:15.585206    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs" event={"ID":"6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2","Type":"ContainerDied","Data":"6c3a22e49a73c895c6a26d67c0d0dfda8a3b5c49eadd4d7ee8ddd2586137069b"}
Sep 11 16:33:15.585431 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:15.585252    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c3a22e49a73c895c6a26d67c0d0dfda8a3b5c49eadd4d7ee8ddd2586137069b"
Sep 11 16:33:16.233715 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.233647    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:33:16.302484 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302451    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-credential-socket\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.302668 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302497    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-socket\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.302668 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302521    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtqbp\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-kube-api-access-jtqbp\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.302804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302695    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2803582-6801-4626-ba78-8602e53bb230-istiod-ca-cert\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.302804 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302744    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-certs\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.302903 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302810    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-envoy\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.302903 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302829    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:16.302903 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302844    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:16.303091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302941    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-istio-token\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.303091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.302983    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-data\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.303091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303033    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2803582-6801-4626-ba78-8602e53bb230-istio-podinfo\") pod \"b2803582-6801-4626-ba78-8602e53bb230\" (UID: \"b2803582-6801-4626-ba78-8602e53bb230\") "
Sep 11 16:33:16.303091 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303059    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:16.303304 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303032    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2803582-6801-4626-ba78-8602e53bb230-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:16.303304 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303285    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:16.303523 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303498    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2803582-6801-4626-ba78-8602e53bb230-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.303644 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303526    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.303644 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303542    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.303644 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303554    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.303644 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.303566    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.304969 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.304932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-kube-api-access-jtqbp" (OuterVolumeSpecName: "kube-api-access-jtqbp") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "kube-api-access-jtqbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:16.305089 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.304966    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:16.305089 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.305001    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2803582-6801-4626-ba78-8602e53bb230-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:33:16.305089 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.305020    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2803582-6801-4626-ba78-8602e53bb230" (UID: "b2803582-6801-4626-ba78-8602e53bb230"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:16.404700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.404654    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtqbp\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-kube-api-access-jtqbp\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.404700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.404691    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2803582-6801-4626-ba78-8602e53bb230-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.404700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.404702    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2803582-6801-4626-ba78-8602e53bb230-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.404700 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.404713    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2803582-6801-4626-ba78-8602e53bb230-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:16.592645 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.592611    2557 generic.go:356] "Generic (PLEG): container finished" podID="b2803582-6801-4626-ba78-8602e53bb230" containerID="7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0" exitCode=0
Sep 11 16:33:16.592645 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.592651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" event={"ID":"b2803582-6801-4626-ba78-8602e53bb230","Type":"ContainerDied","Data":"7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0"}
Sep 11 16:33:16.592885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.592670    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"
Sep 11 16:33:16.592885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.592716    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g" event={"ID":"b2803582-6801-4626-ba78-8602e53bb230","Type":"ContainerDied","Data":"acf26e1f01599d98c08b8509ea2662e8f3db0d623b27e3d492cc0e69796b5f80"}
Sep 11 16:33:16.592885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.592739    2557 scope.go:117] "RemoveContainer" containerID="7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0"
Sep 11 16:33:16.604727 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.604709    2557 scope.go:117] "RemoveContainer" containerID="a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"
Sep 11 16:33:16.613821 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.613794    2557 scope.go:117] "RemoveContainer" containerID="7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0"
Sep 11 16:33:16.614176 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:33:16.614151    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0\": container with ID starting with 7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0 not found: ID does not exist" containerID="7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0"
Sep 11 16:33:16.614273 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.614191    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0"} err="failed to get container status \"7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0\": rpc error: code = NotFound desc = could not find container \"7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0\": container with ID starting with 7e75e281903aa004b0ee550b1ca21c77b3946500082767abc631da79d22b34f0 not found: ID does not exist"
Sep 11 16:33:16.614273 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.614219    2557 scope.go:117] "RemoveContainer" containerID="a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"
Sep 11 16:33:16.614535 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:33:16.614516    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129\": container with ID starting with a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129 not found: ID does not exist" containerID="a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"
Sep 11 16:33:16.614584 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.614541    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129"} err="failed to get container status \"a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129\": rpc error: code = NotFound desc = could not find container \"a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129\": container with ID starting with a4faf60077baa2b4f8e95796bd1304119290c453efde2ce12093e506a59b4129 not found: ID does not exist"
Sep 11 16:33:16.626063 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.626014    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"]
Sep 11 16:33:16.634401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.634368    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9bac29-openshift-default-57576dc498-tnq5g"]
Sep 11 16:33:16.894401 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:16.894309    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2803582-6801-4626-ba78-8602e53bb230" path="/var/lib/kubelet/pods/b2803582-6801-4626-ba78-8602e53bb230/volumes"
Sep 11 16:33:17.191236 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:17.191151    2557 scope.go:117] "RemoveContainer" containerID="261de272cd9e4d7dc249cf9cde7ce6780f66af4a43a64545aa6a352702a5689b"
Sep 11 16:33:22.381754 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:22.381711    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"]
Sep 11 16:33:22.385877 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:22.385846    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-2eae3e-29819070-69nqr"]
Sep 11 16:33:22.798746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:22.798711    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"]
Sep 11 16:33:22.803613 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:22.803583    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-2eae3e-cj5qs"]
Sep 11 16:33:22.894392 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:22.894342    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2" path="/var/lib/kubelet/pods/6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2/volumes"
Sep 11 16:33:22.894769 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:22.894748    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f349394b-9d24-46b4-81a6-fa4bc11465df" path="/var/lib/kubelet/pods/f349394b-9d24-46b4-81a6-fa4bc11465df/volumes"
Sep 11 16:33:31.244034 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.243992    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"]
Sep 11 16:33:31.245142 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245111    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2" containerName="revoke-keys"
Sep 11 16:33:31.245142 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245135    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2" containerName="revoke-keys"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245157    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245166    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245183    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245189    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245262    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245274    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2803582-6801-4626-ba78-8602e53bb230" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245283    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb4d7605-91ef-4398-9ccd-bf766b499ed9" containerName="istio-proxy"
Sep 11 16:33:31.245361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.245293    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cde0123-6fcc-4f83-8e5a-3b7e8539a4b2" containerName="revoke-keys"
Sep 11 16:33:31.248779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.248760    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:31.255629 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.255599    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:33:31.256770 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.256743    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:33:31.289068 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.289012    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"]
Sep 11 16:33:31.349715 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.349665    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17570b37-35bd-4f4e-8074-5db04eaac3b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj\" (UID: \"17570b37-35bd-4f4e-8074-5db04eaac3b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:31.450305 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.450267    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17570b37-35bd-4f4e-8074-5db04eaac3b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj\" (UID: \"17570b37-35bd-4f4e-8074-5db04eaac3b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:31.450898 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.450879    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17570b37-35bd-4f4e-8074-5db04eaac3b0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj\" (UID: \"17570b37-35bd-4f4e-8074-5db04eaac3b0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:31.558784 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.558745    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:31.859883 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:31.859846    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"]
Sep 11 16:33:31.861528 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:33:31.861500    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17570b37_35bd_4f4e_8074_5db04eaac3b0.slice/crio-bb6e4a1179f4aa6fc4e630ef88a076fcd925845e0b053130652893f866052a08 WatchSource:0}: Error finding container bb6e4a1179f4aa6fc4e630ef88a076fcd925845e0b053130652893f866052a08: Status 404 returned error can't find the container with id bb6e4a1179f4aa6fc4e630ef88a076fcd925845e0b053130652893f866052a08
Sep 11 16:33:32.679097 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:32.679035    2557 generic.go:356] "Generic (PLEG): container finished" podID="17570b37-35bd-4f4e-8074-5db04eaac3b0" containerID="e92f40efc873e4c8ed646f1feea1a901fb929aa46c95734736a10db9cdd5c0f1" exitCode=0
Sep 11 16:33:32.679097 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:32.679089    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj" event={"ID":"17570b37-35bd-4f4e-8074-5db04eaac3b0","Type":"ContainerDied","Data":"e92f40efc873e4c8ed646f1feea1a901fb929aa46c95734736a10db9cdd5c0f1"}
Sep 11 16:33:32.679514 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:32.679152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj" event={"ID":"17570b37-35bd-4f4e-8074-5db04eaac3b0","Type":"ContainerStarted","Data":"bb6e4a1179f4aa6fc4e630ef88a076fcd925845e0b053130652893f866052a08"}
Sep 11 16:33:33.824866 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:33.824836    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:33.975207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:33.975116    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17570b37-35bd-4f4e-8074-5db04eaac3b0-maas-api-service-ca\") pod \"17570b37-35bd-4f4e-8074-5db04eaac3b0\" (UID: \"17570b37-35bd-4f4e-8074-5db04eaac3b0\") "
Sep 11 16:33:33.975508 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:33.975483    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17570b37-35bd-4f4e-8074-5db04eaac3b0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "17570b37-35bd-4f4e-8074-5db04eaac3b0" (UID: "17570b37-35bd-4f4e-8074-5db04eaac3b0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:34.076846 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:34.076810    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/17570b37-35bd-4f4e-8074-5db04eaac3b0-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:34.690179 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:34.690151    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"
Sep 11 16:33:34.690360 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:34.690197    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj" event={"ID":"17570b37-35bd-4f4e-8074-5db04eaac3b0","Type":"ContainerDied","Data":"bb6e4a1179f4aa6fc4e630ef88a076fcd925845e0b053130652893f866052a08"}
Sep 11 16:33:34.690360 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:34.690249    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb6e4a1179f4aa6fc4e630ef88a076fcd925845e0b053130652893f866052a08"
Sep 11 16:33:42.025916 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:42.025831    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"]
Sep 11 16:33:42.035037 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:42.035001    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ec6e6-29819070-znglw"]
Sep 11 16:33:42.319629 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:42.319585    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"]
Sep 11 16:33:42.326365 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:42.326329    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1ec6e6-xckvj"]
Sep 11 16:33:42.893109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:42.893061    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17570b37-35bd-4f4e-8074-5db04eaac3b0" path="/var/lib/kubelet/pods/17570b37-35bd-4f4e-8074-5db04eaac3b0/volumes"
Sep 11 16:33:42.893481 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:42.893462    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e09b6fc-f69d-4b24-9c4c-99f01d8985f7" path="/var/lib/kubelet/pods/8e09b6fc-f69d-4b24-9c4c-99f01d8985f7/volumes"
Sep 11 16:33:49.278839 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.278806    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"]
Sep 11 16:33:49.279347 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.279130    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy" containerID="cri-o://72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518" gracePeriod=30
Sep 11 16:33:49.620885 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.620848    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"]
Sep 11 16:33:49.621333 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.621316    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17570b37-35bd-4f4e-8074-5db04eaac3b0" containerName="revoke-keys"
Sep 11 16:33:49.621441 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.621335    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17570b37-35bd-4f4e-8074-5db04eaac3b0" containerName="revoke-keys"
Sep 11 16:33:49.621503 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.621443    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="17570b37-35bd-4f4e-8074-5db04eaac3b0" containerName="revoke-keys"
Sep 11 16:33:49.625799 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.625774    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:49.629032 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.629004    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-t9ktk\""
Sep 11 16:33:49.630930 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.630907    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:33:49.642294 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.642261    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"]
Sep 11 16:33:49.729918 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.729875    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49944c17-46b0-4f3d-bc0d-144ac1fb1501-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx\" (UID: \"49944c17-46b0-4f3d-bc0d-144ac1fb1501\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:49.830795 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.830751    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49944c17-46b0-4f3d-bc0d-144ac1fb1501-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx\" (UID: \"49944c17-46b0-4f3d-bc0d-144ac1fb1501\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:49.831433 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.831405    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49944c17-46b0-4f3d-bc0d-144ac1fb1501-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx\" (UID: \"49944c17-46b0-4f3d-bc0d-144ac1fb1501\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:49.936206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:49.936123    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:50.220665 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:50.220640    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"]
Sep 11 16:33:50.223108 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:33:50.223071    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49944c17_46b0_4f3d_bc0d_144ac1fb1501.slice/crio-022e4b0ddf11f8c8b55c0c8fc9e12148fe23edccbb123e727153ac35141e677c WatchSource:0}: Error finding container 022e4b0ddf11f8c8b55c0c8fc9e12148fe23edccbb123e727153ac35141e677c: Status 404 returned error can't find the container with id 022e4b0ddf11f8c8b55c0c8fc9e12148fe23edccbb123e727153ac35141e677c
Sep 11 16:33:50.779419 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:50.779377    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx" event={"ID":"49944c17-46b0-4f3d-bc0d-144ac1fb1501","Type":"ContainerStarted","Data":"b601a8b12b66c3a6152fe5444b8970f4895a43a78ddbd818ef5d1ce72e02e8a5"}
Sep 11 16:33:50.779848 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:50.779449    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx" event={"ID":"49944c17-46b0-4f3d-bc0d-144ac1fb1501","Type":"ContainerStarted","Data":"022e4b0ddf11f8c8b55c0c8fc9e12148fe23edccbb123e727153ac35141e677c"}
Sep 11 16:33:50.807019 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:50.806905    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx" podStartSLOduration=1.80688637 podStartE2EDuration="1.80688637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:33:50.805327892 +0000 UTC m=+1894.355515744" watchObservedRunningTime="2026-09-11 16:33:50.80688637 +0000 UTC m=+1894.357074224"
Sep 11 16:33:51.785811 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:51.785775    2557 generic.go:356] "Generic (PLEG): container finished" podID="49944c17-46b0-4f3d-bc0d-144ac1fb1501" containerID="b601a8b12b66c3a6152fe5444b8970f4895a43a78ddbd818ef5d1ce72e02e8a5" exitCode=0
Sep 11 16:33:51.786226 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:51.785849    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx" event={"ID":"49944c17-46b0-4f3d-bc0d-144ac1fb1501","Type":"ContainerDied","Data":"b601a8b12b66c3a6152fe5444b8970f4895a43a78ddbd818ef5d1ce72e02e8a5"}
Sep 11 16:33:52.930825 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:52.930796    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:52.961966 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:52.961923    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49944c17-46b0-4f3d-bc0d-144ac1fb1501-maas-api-service-ca\") pod \"49944c17-46b0-4f3d-bc0d-144ac1fb1501\" (UID: \"49944c17-46b0-4f3d-bc0d-144ac1fb1501\") "
Sep 11 16:33:52.962718 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:52.962365    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49944c17-46b0-4f3d-bc0d-144ac1fb1501-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49944c17-46b0-4f3d-bc0d-144ac1fb1501" (UID: "49944c17-46b0-4f3d-bc0d-144ac1fb1501"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:52.962913 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:52.962889    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49944c17-46b0-4f3d-bc0d-144ac1fb1501-maas-api-service-ca\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:53.798631 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:53.798591    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"
Sep 11 16:33:53.798631 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:53.798615    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx" event={"ID":"49944c17-46b0-4f3d-bc0d-144ac1fb1501","Type":"ContainerDied","Data":"022e4b0ddf11f8c8b55c0c8fc9e12148fe23edccbb123e727153ac35141e677c"}
Sep 11 16:33:53.798852 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:53.798676    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="022e4b0ddf11f8c8b55c0c8fc9e12148fe23edccbb123e727153ac35141e677c"
Sep 11 16:33:54.528197 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.528168    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:33:54.580258 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580220    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-certs\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580267    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-credential-socket\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580292    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-socket\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580324    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-data\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580371    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-envoy\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580399    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tbtn\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-kube-api-access-5tbtn\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580465 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580449    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fb79636-a7d6-4343-8999-2287782a02ea-istio-podinfo\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580484    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fb79636-a7d6-4343-8999-2287782a02ea-istiod-ca-cert\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580553    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:54.580774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580597    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:54.580774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580606    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:54.580774 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580623    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-istio-token\") pod \"6fb79636-a7d6-4343-8999-2287782a02ea\" (UID: \"6fb79636-a7d6-4343-8999-2287782a02ea\") "
Sep 11 16:33:54.580984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580853    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:54.580984 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.580862    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fb79636-a7d6-4343-8999-2287782a02ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:54.581123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.581076    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.581123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.581097    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-credential-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.581123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.581107    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-workload-socket\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.581123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.581117    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-data\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.581123 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.581125    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fb79636-a7d6-4343-8999-2287782a02ea-istiod-ca-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.582756 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.582725    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:54.582872 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.582796    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:33:54.583026 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.583000    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fb79636-a7d6-4343-8999-2287782a02ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:33:54.583168 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.583038    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-kube-api-access-5tbtn" (OuterVolumeSpecName: "kube-api-access-5tbtn") pod "6fb79636-a7d6-4343-8999-2287782a02ea" (UID: "6fb79636-a7d6-4343-8999-2287782a02ea"). InnerVolumeSpecName "kube-api-access-5tbtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:54.681779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.681739    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fb79636-a7d6-4343-8999-2287782a02ea-istio-envoy\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.681779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.681773    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tbtn\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-kube-api-access-5tbtn\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.681779 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.681788    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fb79636-a7d6-4343-8999-2287782a02ea-istio-podinfo\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.682027 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.681796    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fb79636-a7d6-4343-8999-2287782a02ea-istio-token\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:33:54.808682 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.808643    2557 generic.go:356] "Generic (PLEG): container finished" podID="6fb79636-a7d6-4343-8999-2287782a02ea" containerID="72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518" exitCode=0
Sep 11 16:33:54.808860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.808701    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"
Sep 11 16:33:54.808860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.808735    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" event={"ID":"6fb79636-a7d6-4343-8999-2287782a02ea","Type":"ContainerDied","Data":"72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518"}
Sep 11 16:33:54.808860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.808800    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57" event={"ID":"6fb79636-a7d6-4343-8999-2287782a02ea","Type":"ContainerDied","Data":"e764cec955a149de54723b1b115fb23088c060bdade09ff39e340e85f3da76da"}
Sep 11 16:33:54.808860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.808829    2557 scope.go:117] "RemoveContainer" containerID="72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518"
Sep 11 16:33:54.818542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.818521    2557 scope.go:117] "RemoveContainer" containerID="f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"
Sep 11 16:33:54.827341 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.827318    2557 scope.go:117] "RemoveContainer" containerID="72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518"
Sep 11 16:33:54.827612 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:33:54.827593    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518\": container with ID starting with 72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518 not found: ID does not exist" containerID="72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518"
Sep 11 16:33:54.827663 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.827621    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518"} err="failed to get container status \"72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518\": rpc error: code = NotFound desc = could not find container \"72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518\": container with ID starting with 72eb9dcd874fdd36b3bcdf5ff776baa7af269fa888c65e242821a55c4c822518 not found: ID does not exist"
Sep 11 16:33:54.827663 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.827639    2557 scope.go:117] "RemoveContainer" containerID="f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"
Sep 11 16:33:54.827911 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:33:54.827889    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c\": container with ID starting with f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c not found: ID does not exist" containerID="f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"
Sep 11 16:33:54.827961 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.827918    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c"} err="failed to get container status \"f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c\": rpc error: code = NotFound desc = could not find container \"f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c\": container with ID starting with f5937a15b5bf1289c2a4b3f182e7d346b4887f415326a59fe278b52aa24ed39c not found: ID does not exist"
Sep 11 16:33:54.847015 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.846935    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"]
Sep 11 16:33:54.848708 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.848685    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ec6e6-openshift-default-84c47dfb96-q9b57"]
Sep 11 16:33:54.893280 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:33:54.893242    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" path="/var/lib/kubelet/pods/6fb79636-a7d6-4343-8999-2287782a02ea/volumes"
Sep 11 16:34:00.476122 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.476077    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"]
Sep 11 16:34:00.477783 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.477756    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-233d22-29819070-24b5r"]
Sep 11 16:34:00.509294 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.509257    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"]
Sep 11 16:34:00.509563 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.509534    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" podUID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" containerName="payload-processing" containerID="cri-o://26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7" gracePeriod=30
Sep 11 16:34:00.572538 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.572493    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" podUID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.52:9004: connect: connection refused"
Sep 11 16:34:00.756536 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.756505    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"]
Sep 11 16:34:00.761296 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.761270    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-233d22-trrlx"]
Sep 11 16:34:00.776552 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.776529    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:34:00.840468 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.840441    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwl87\" (UniqueName: \"kubernetes.io/projected/a4dc2def-faef-425d-a7b5-06bfa2ae162b-kube-api-access-dwl87\") pod \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") "
Sep 11 16:34:00.840651 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.840498    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4dc2def-faef-425d-a7b5-06bfa2ae162b-plugins-config-volume\") pod \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\" (UID: \"a4dc2def-faef-425d-a7b5-06bfa2ae162b\") "
Sep 11 16:34:00.840911 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.840886    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4dc2def-faef-425d-a7b5-06bfa2ae162b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a4dc2def-faef-425d-a7b5-06bfa2ae162b" (UID: "a4dc2def-faef-425d-a7b5-06bfa2ae162b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:34:00.842815 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.842771    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4dc2def-faef-425d-a7b5-06bfa2ae162b-kube-api-access-dwl87" (OuterVolumeSpecName: "kube-api-access-dwl87") pod "a4dc2def-faef-425d-a7b5-06bfa2ae162b" (UID: "a4dc2def-faef-425d-a7b5-06bfa2ae162b"). InnerVolumeSpecName "kube-api-access-dwl87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:00.844106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.844079    2557 generic.go:356] "Generic (PLEG): container finished" podID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" containerID="26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7" exitCode=0
Sep 11 16:34:00.844106 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.844112    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"
Sep 11 16:34:00.844244 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.844142    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" event={"ID":"a4dc2def-faef-425d-a7b5-06bfa2ae162b","Type":"ContainerDied","Data":"26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7"}
Sep 11 16:34:00.844244 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.844204    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5" event={"ID":"a4dc2def-faef-425d-a7b5-06bfa2ae162b","Type":"ContainerDied","Data":"d169ad8c8a120068d73ad71c5cf9878331f3fc63989e147819d34a7465c540ab"}
Sep 11 16:34:00.844244 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.844230    2557 scope.go:117] "RemoveContainer" containerID="26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7"
Sep 11 16:34:00.855543 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.855519    2557 scope.go:117] "RemoveContainer" containerID="26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7"
Sep 11 16:34:00.855893 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:34:00.855870    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7\": container with ID starting with 26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7 not found: ID does not exist" containerID="26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7"
Sep 11 16:34:00.855933 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.855904    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7"} err="failed to get container status \"26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7\": rpc error: code = NotFound desc = could not find container \"26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7\": container with ID starting with 26aa52d2855e5a7836dc1e4955f6c1cf5c36d9b44fdfc5128a5ead0dacca83d7 not found: ID does not exist"
Sep 11 16:34:00.876998 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.876938    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"]
Sep 11 16:34:00.893023 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.892986    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49944c17-46b0-4f3d-bc0d-144ac1fb1501" path="/var/lib/kubelet/pods/49944c17-46b0-4f3d-bc0d-144ac1fb1501/volumes"
Sep 11 16:34:00.893339 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.893321    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8d7dc56-4a37-4d5e-a48f-f0224122718c" path="/var/lib/kubelet/pods/f8d7dc56-4a37-4d5e-a48f-f0224122718c/volumes"
Sep 11 16:34:00.893575 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.893559    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-233d22-8f74ff9df-558k5"]
Sep 11 16:34:00.941680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.941640    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwl87\" (UniqueName: \"kubernetes.io/projected/a4dc2def-faef-425d-a7b5-06bfa2ae162b-kube-api-access-dwl87\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:34:00.941680 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:00.941672    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4dc2def-faef-425d-a7b5-06bfa2ae162b-plugins-config-volume\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:34:02.892027 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:02.891991    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" path="/var/lib/kubelet/pods/a4dc2def-faef-425d-a7b5-06bfa2ae162b/volumes"
Sep 11 16:34:10.744225 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:10.744184    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c667ccddd-8msmf"]
Sep 11 16:34:10.744657 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:10.744463    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-c667ccddd-8msmf" podUID="6633379c-635d-4d73-8bcf-ebb2f68b4a73" containerName="manager" containerID="cri-o://d6308f4c4a60a2544632e9316dcddfd3097780ca77d243b2fef7badeb88234b4" gracePeriod=30
Sep 11 16:34:10.898414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:10.898371    2557 generic.go:356] "Generic (PLEG): container finished" podID="6633379c-635d-4d73-8bcf-ebb2f68b4a73" containerID="d6308f4c4a60a2544632e9316dcddfd3097780ca77d243b2fef7badeb88234b4" exitCode=0
Sep 11 16:34:10.898599 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:10.898456    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-8msmf" event={"ID":"6633379c-635d-4d73-8bcf-ebb2f68b4a73","Type":"ContainerDied","Data":"d6308f4c4a60a2544632e9316dcddfd3097780ca77d243b2fef7badeb88234b4"}
Sep 11 16:34:10.999436 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:10.999375    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:34:11.137344 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.137306    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-metrics-certs\") pod \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") "
Sep 11 16:34:11.137344 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.137350    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jzbs\" (UniqueName: \"kubernetes.io/projected/6633379c-635d-4d73-8bcf-ebb2f68b4a73-kube-api-access-5jzbs\") pod \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") "
Sep 11 16:34:11.137568 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.137467    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-webhook-cert\") pod \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\" (UID: \"6633379c-635d-4d73-8bcf-ebb2f68b4a73\") "
Sep 11 16:34:11.139656 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.139619    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6633379c-635d-4d73-8bcf-ebb2f68b4a73" (UID: "6633379c-635d-4d73-8bcf-ebb2f68b4a73"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:34:11.139773 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.139674    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6633379c-635d-4d73-8bcf-ebb2f68b4a73" (UID: "6633379c-635d-4d73-8bcf-ebb2f68b4a73"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:34:11.139773 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.139685    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6633379c-635d-4d73-8bcf-ebb2f68b4a73-kube-api-access-5jzbs" (OuterVolumeSpecName: "kube-api-access-5jzbs") pod "6633379c-635d-4d73-8bcf-ebb2f68b4a73" (UID: "6633379c-635d-4d73-8bcf-ebb2f68b4a73"). InnerVolumeSpecName "kube-api-access-5jzbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:11.239200 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.239160    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-webhook-cert\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:34:11.239200 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.239193    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6633379c-635d-4d73-8bcf-ebb2f68b4a73-metrics-certs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:34:11.239417 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.239205    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jzbs\" (UniqueName: \"kubernetes.io/projected/6633379c-635d-4d73-8bcf-ebb2f68b4a73-kube-api-access-5jzbs\") on node \"ip-10-0-130-241.ec2.internal\" DevicePath \"\""
Sep 11 16:34:11.905366 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.905329    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-8msmf" event={"ID":"6633379c-635d-4d73-8bcf-ebb2f68b4a73","Type":"ContainerDied","Data":"bec07e1a20ad21c295828a1980f954894fad825544f84e92ef08b486014feb3f"}
Sep 11 16:34:11.905815 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.905387    2557 scope.go:117] "RemoveContainer" containerID="d6308f4c4a60a2544632e9316dcddfd3097780ca77d243b2fef7badeb88234b4"
Sep 11 16:34:11.905815 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.905338    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667ccddd-8msmf"
Sep 11 16:34:11.943306 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.943272    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c667ccddd-8msmf"]
Sep 11 16:34:11.944860 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:11.944835    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c667ccddd-8msmf"]
Sep 11 16:34:12.893469 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:12.893429    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6633379c-635d-4d73-8bcf-ebb2f68b4a73" path="/var/lib/kubelet/pods/6633379c-635d-4d73-8bcf-ebb2f68b4a73/volumes"
Sep 11 16:34:17.221209 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:17.221176    2557 scope.go:117] "RemoveContainer" containerID="0788d74db21791ae16d412f599d0d6f7fa6a59cfbd6f82277ed83999b415b904"
Sep 11 16:34:17.229917 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:17.229894    2557 scope.go:117] "RemoveContainer" containerID="45b141837731e64bd97bd2eae8e945d8bd3dbe105b6dc36c82abd5e05fac7417"
Sep 11 16:34:17.239838 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:34:17.239816    2557 scope.go:117] "RemoveContainer" containerID="fb59ce8aa9da8f06b2123296eb1f0587a02a2d5b11ad36f121df16554f315686"
Sep 11 16:35:15.789372 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789294    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c667ccddd-pqpd4"]
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789648    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6633379c-635d-4d73-8bcf-ebb2f68b4a73" containerName="manager"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789659    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6633379c-635d-4d73-8bcf-ebb2f68b4a73" containerName="manager"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789674    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" containerName="payload-processing"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789680    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" containerName="payload-processing"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789689    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789695    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789703    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789708    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789718    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49944c17-46b0-4f3d-bc0d-144ac1fb1501" containerName="revoke-keys"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789723    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49944c17-46b0-4f3d-bc0d-144ac1fb1501" containerName="revoke-keys"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789770    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6633379c-635d-4d73-8bcf-ebb2f68b4a73" containerName="manager"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789779    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789784    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fb79636-a7d6-4343-8999-2287782a02ea" containerName="istio-proxy"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789790    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4dc2def-faef-425d-a7b5-06bfa2ae162b" containerName="payload-processing"
Sep 11 16:35:15.789802 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.789796    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49944c17-46b0-4f3d-bc0d-144ac1fb1501" containerName="revoke-keys"
Sep 11 16:35:15.792979 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.792963    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.830232 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.830203    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 16:35:15.830232 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.830204    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 16:35:15.830467 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.830246    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 16:35:15.830467 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.830255    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5frtc\""
Sep 11 16:35:15.848542 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.848512    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df82528-a3b5-4762-8a1f-1cda82e6bda8-metrics-certs\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.848614 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.848568    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8df82528-a3b5-4762-8a1f-1cda82e6bda8-webhook-cert\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.848648 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.848635    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh977\" (UniqueName: \"kubernetes.io/projected/8df82528-a3b5-4762-8a1f-1cda82e6bda8-kube-api-access-sh977\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.949399 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.949360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh977\" (UniqueName: \"kubernetes.io/projected/8df82528-a3b5-4762-8a1f-1cda82e6bda8-kube-api-access-sh977\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.949596 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.949445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df82528-a3b5-4762-8a1f-1cda82e6bda8-metrics-certs\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.949596 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.949488    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8df82528-a3b5-4762-8a1f-1cda82e6bda8-webhook-cert\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.951997 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.951966    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df82528-a3b5-4762-8a1f-1cda82e6bda8-metrics-certs\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.952131 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.952023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8df82528-a3b5-4762-8a1f-1cda82e6bda8-webhook-cert\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:15.961460 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:15.961432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh977\" (UniqueName: \"kubernetes.io/projected/8df82528-a3b5-4762-8a1f-1cda82e6bda8-kube-api-access-sh977\") pod \"maas-controller-c667ccddd-pqpd4\" (UID: \"8df82528-a3b5-4762-8a1f-1cda82e6bda8\") " pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:16.102875 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:16.102841    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:17.278031 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:17.277997    2557 scope.go:117] "RemoveContainer" containerID="25d2a46ab0f83b00f7d859fbc441c3626f5dab71aeb334ed195c8e066afde3d4"
Sep 11 16:35:30.304382 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:30.304347    2557 generic.go:356] "Generic (PLEG): container finished" podID="e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3" containerID="ab8b1aa3a6c8f3ebae7689185812e96a6a1a59797b9490e91095392295008df4" exitCode=1
Sep 11 16:35:30.304882 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:30.304422    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" event={"ID":"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3","Type":"ContainerDied","Data":"ab8b1aa3a6c8f3ebae7689185812e96a6a1a59797b9490e91095392295008df4"}
Sep 11 16:35:30.304882 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:30.304790    2557 scope.go:117] "RemoveContainer" containerID="ab8b1aa3a6c8f3ebae7689185812e96a6a1a59797b9490e91095392295008df4"
Sep 11 16:35:31.316781 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:31.316741    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" event={"ID":"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3","Type":"ContainerStarted","Data":"fe80db32f85374b951ef1ac888c2c60e4ca7b316405eacfad808a2d113e18b5e"}
Sep 11 16:35:31.317190 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:31.316964    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:35:33.404249 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:35:33.404195    2557 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8df82528-a3b5-4762-8a1f-1cda82e6bda8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-11T16:35:15Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-11T16:35:15Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-11T16:35:15Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-09-11T16:35:15Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/opendatahub/maas-controller@sha256:2588fc7c3b8a88803b00cfb7515937d7e571c86d7d01115bec4741006e14939a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/k8s-webhook-server/serving-certs\\\",\\\"name\\\":\\\"webhook-cert\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/tmp/k8s-metrics-server/metrics-certs\\\",\\\"name\\\":\\\"metrics-certs\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-sh977\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.130.241\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.130.241\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-09-11T16:35:15Z\\\"}}\" for pod \"opendatahub\"/\"maas-controller-c667ccddd-pqpd4\": Internal error occurred: admission plugin \"ValidatingAdmissionWebhook\" failed to complete validation in 13s" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:33.416290 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:35:33.416239    2557 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-241.ec2.internal?timeout=10s\": context deadline exceeded"
Sep 11 16:35:33.548980 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:33.548945    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c667ccddd-pqpd4"]
Sep 11 16:35:33.632383 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:35:33.632348    2557 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-130-241.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Sep 11 16:35:33.865673 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:33.865644    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c667ccddd-pqpd4"]
Sep 11 16:35:33.868691 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:35:33.868619    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df82528_a3b5_4762_8a1f_1cda82e6bda8.slice/crio-96a8d1fc1d48fb2ebeff0a136ded96b4e78e17da68234ef1ec6378a1ef838955 WatchSource:0}: Error finding container 96a8d1fc1d48fb2ebeff0a136ded96b4e78e17da68234ef1ec6378a1ef838955: Status 404 returned error can't find the container with id 96a8d1fc1d48fb2ebeff0a136ded96b4e78e17da68234ef1ec6378a1ef838955
Sep 11 16:35:33.870199 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:33.870178    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:35:34.333363 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:34.333327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-pqpd4" event={"ID":"8df82528-a3b5-4762-8a1f-1cda82e6bda8","Type":"ContainerStarted","Data":"96a8d1fc1d48fb2ebeff0a136ded96b4e78e17da68234ef1ec6378a1ef838955"}
Sep 11 16:35:34.453915 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:34.453890    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 16:35:35.339855 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:35.339818    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-pqpd4" event={"ID":"8df82528-a3b5-4762-8a1f-1cda82e6bda8","Type":"ContainerStarted","Data":"480105887a70649c71c50e97fdac3f34ecbed51e4ecd795fdfe4327d8912a353"}
Sep 11 16:35:35.340088 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:35.339952    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:35:35.385762 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:35.385700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c667ccddd-pqpd4" podStartSLOduration=20.808578569 podStartE2EDuration="21.38568245s" totalImagesPullingTime="577.103881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:35.385171212 +0000 UTC m=+1998.935359067" watchObservedRunningTime="2026-09-11 16:35:35.38568245 +0000 UTC m=+1998.935870302"
Sep 11 16:35:42.325156 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:42.325121    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:35:46.347727 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:35:46.347692    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:36:17.297663 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:17.297630    2557 scope.go:117] "RemoveContainer" containerID="8b3775dc41e06e3df89de9009aa10274df42a1c7cf9dd81751862cae0b37311a"
Sep 11 16:36:17.306092 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:17.306073    2557 scope.go:117] "RemoveContainer" containerID="ed476e4e35d9fc859813c74e25868559d2d6b1149db794536d10c0a14a075f8f"
Sep 11 16:36:17.313361 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:17.313338    2557 scope.go:117] "RemoveContainer" containerID="d23ea2d55553e1b1bbb41377be7e48c1202f2bdae311d0d1b9aa72746fb3e1b4"
Sep 11 16:36:23.583118 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.583088    2557 generic.go:356] "Generic (PLEG): container finished" podID="e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3" containerID="fe80db32f85374b951ef1ac888c2c60e4ca7b316405eacfad808a2d113e18b5e" exitCode=1
Sep 11 16:36:23.583440 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.583158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" event={"ID":"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3","Type":"ContainerDied","Data":"fe80db32f85374b951ef1ac888c2c60e4ca7b316405eacfad808a2d113e18b5e"}
Sep 11 16:36:23.583440 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.583215    2557 scope.go:117] "RemoveContainer" containerID="ab8b1aa3a6c8f3ebae7689185812e96a6a1a59797b9490e91095392295008df4"
Sep 11 16:36:23.583565 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.583551    2557 scope.go:117] "RemoveContainer" containerID="fe80db32f85374b951ef1ac888c2c60e4ca7b316405eacfad808a2d113e18b5e"
Sep 11 16:36:23.583805 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:36:23.583784    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=lws-controller-manager-7d9ffdf556-fg2nw_openshift-lws-operator(e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3)\"" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" podUID="e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3"
Sep 11 16:36:23.584765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.584744    2557 generic.go:356] "Generic (PLEG): container finished" podID="8df82528-a3b5-4762-8a1f-1cda82e6bda8" containerID="480105887a70649c71c50e97fdac3f34ecbed51e4ecd795fdfe4327d8912a353" exitCode=1
Sep 11 16:36:23.584837 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.584786    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-pqpd4" event={"ID":"8df82528-a3b5-4762-8a1f-1cda82e6bda8","Type":"ContainerDied","Data":"480105887a70649c71c50e97fdac3f34ecbed51e4ecd795fdfe4327d8912a353"}
Sep 11 16:36:23.587463 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:23.585153    2557 scope.go:117] "RemoveContainer" containerID="480105887a70649c71c50e97fdac3f34ecbed51e4ecd795fdfe4327d8912a353"
Sep 11 16:36:24.591356 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:24.591320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c667ccddd-pqpd4" event={"ID":"8df82528-a3b5-4762-8a1f-1cda82e6bda8","Type":"ContainerStarted","Data":"7bf10ab343798b961819bcd616f5663fd35daf407e6e150c3f99d800f53cd7f9"}
Sep 11 16:36:24.591970 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:24.591541    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:36:29.446420 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:36:29.446374    2557 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-241.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:32.322735 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:32.322693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:36:32.325116 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:32.323171    2557 scope.go:117] "RemoveContainer" containerID="fe80db32f85374b951ef1ac888c2c60e4ca7b316405eacfad808a2d113e18b5e"
Sep 11 16:36:32.325116 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:36:32.323359    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=lws-controller-manager-7d9ffdf556-fg2nw_openshift-lws-operator(e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3)\"" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" podUID="e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3"
Sep 11 16:36:35.600071 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:35.600005    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-c667ccddd-pqpd4" podUID="8df82528-a3b5-4762-8a1f-1cda82e6bda8" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.79:8081/readyz\": dial tcp 10.133.0.79:8081: connect: connection refused"
Sep 11 16:36:36.907477 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:36.907421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:36:36.907876 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:36.907858    2557 scope.go:117] "RemoveContainer" containerID="fe80db32f85374b951ef1ac888c2c60e4ca7b316405eacfad808a2d113e18b5e"
Sep 11 16:36:37.659884 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:37.659838    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw" event={"ID":"e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3","Type":"ContainerStarted","Data":"65415062a9f395f7b62616a57d6989654d992ca5926477a2b358292c8c6a7c96"}
Sep 11 16:36:37.660132 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:37.660107    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:36:39.446993 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:36:39.446905    2557 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-241.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:45.599356 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:45.599310    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-c667ccddd-pqpd4" podUID="8df82528-a3b5-4762-8a1f-1cda82e6bda8" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.79:8081/readyz\": dial tcp 10.133.0.79:8081: connect: connection refused"
Sep 11 16:36:48.668311 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:48.668278    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d9ffdf556-fg2nw"
Sep 11 16:36:49.448014 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:36:49.447972    2557 controller.go:195] "Failed to update lease" err="Put \"https://a6166511cd9264054a0e0222758160b6-fe0a73c1a588f6e1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-241.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:36:51.877022 ip-10-0-130-241 kubenswrapper[2557]: E0911 16:36:51.876986    2557 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-130-241.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Sep 11 16:36:55.599978 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:36:55.599944    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c667ccddd-pqpd4"
Sep 11 16:37:16.989831 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:16.989800    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:37:16.994765 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:16.994740    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d9gbr_da590729-c278-4d83-81b0-2105f798493b/ovn-acl-logging/0.log"
Sep 11 16:37:22.447189 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:22.447152    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c667ccddd-pqpd4_8df82528-a3b5-4762-8a1f-1cda82e6bda8/manager/1.log"
Sep 11 16:37:22.994440 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:22.994411    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-j2b7j_ad188a88-f33a-4e73-92ee-216fb4f1993b/copy-manifests/0.log"
Sep 11 16:37:23.019631 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:23.019609    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-j2b7j_ad188a88-f33a-4e73-92ee-216fb4f1993b/manager/0.log"
Sep 11 16:37:23.883606 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:23.883582    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819070-h5p8x_5ff47837-4fdd-4825-adc8-9592f654b018/cleanup/0.log"
Sep 11 16:37:26.066755 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:26.066724    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc_4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35/istio-proxy/0.log"
Sep 11 16:37:26.217148 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:26.217122    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k55b7_ab138496-5ed2-4435-b4cb-9dc91c65ab06/discovery/0.log"
Sep 11 16:37:26.615057 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:26.615015    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/1.log"
Sep 11 16:37:26.899607 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:26.899533    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sgpws_04eac8d5-8c67-44e5-9b04-44f2c7693dac/payload-processing/0.log"
Sep 11 16:37:27.040204 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:27.040176    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-769b995cc4-mf8xv_e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709/router/0.log"
Sep 11 16:37:27.564582 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:27.564557    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mpbrw_189917f7-f739-4a49-b53c-298be5ddfc32/main/0.log"
Sep 11 16:37:27.971821 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:27.971743    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fhvkb6_2c407c59-2ebe-4606-a519-b73c536c3220/main/0.log"
Sep 11 16:37:39.191174 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:39.191138    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xh55j_f5f1e729-f8fd-4c9c-a481-c2c58b8cb1cc/global-pull-secret-syncer/0.log"
Sep 11 16:37:39.700412 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:39.700382    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ws8nc_14a93f7c-98ff-4c9b-98bb-76a40f9ef7dc/konnectivity-agent/0.log"
Sep 11 16:37:39.825492 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:39.825462    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-241.ec2.internal_3d106852fe9cba1c1b928ec423e65e68/haproxy/0.log"
Sep 11 16:37:46.042951 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.042855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-5c8l7_e339260b-512e-48e1-a994-d1d01ccc80e0/cluster-monitoring-operator/0.log"
Sep 11 16:37:46.365745 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.365700    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-xzpd2_2e9aafbd-4811-431f-a37f-0c4ccf8eb85b/monitoring-plugin/0.log"
Sep 11 16:37:46.560967 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.560942    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4sln_1b99a22e-4f78-4757-a951-2576cdba42f7/node-exporter/0.log"
Sep 11 16:37:46.606118 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.606083    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4sln_1b99a22e-4f78-4757-a951-2576cdba42f7/kube-rbac-proxy/0.log"
Sep 11 16:37:46.638318 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.638265    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g4sln_1b99a22e-4f78-4757-a951-2576cdba42f7/init-textfile/0.log"
Sep 11 16:37:46.835130 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.835100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tpq85_be1f1026-c883-4f16-b86c-f82e7f299336/kube-rbac-proxy-main/0.log"
Sep 11 16:37:46.962082 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:46.961974    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tpq85_be1f1026-c883-4f16-b86c-f82e7f299336/kube-rbac-proxy-self/0.log"
Sep 11 16:37:47.077394 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.077366    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-tpq85_be1f1026-c883-4f16-b86c-f82e7f299336/openshift-state-metrics/0.log"
Sep 11 16:37:47.192566 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.192529    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/prometheus/0.log"
Sep 11 16:37:47.247111 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.247007    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/config-reloader/0.log"
Sep 11 16:37:47.305103 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.305058    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/thanos-sidecar/0.log"
Sep 11 16:37:47.340562 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.340521    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/kube-rbac-proxy-web/0.log"
Sep 11 16:37:47.380450 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.380428    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/kube-rbac-proxy/0.log"
Sep 11 16:37:47.430419 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.430394    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/kube-rbac-proxy-thanos/0.log"
Sep 11 16:37:47.472777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.472756    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_26ff7bdb-6253-4196-be2c-7d7999a74daf/init-config-reloader/0.log"
Sep 11 16:37:47.806110 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.806079    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7498889567-kj7pg_88698f1b-e5e1-44da-9511-350e5916b6b8/thanos-query/0.log"
Sep 11 16:37:47.844145 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.844115    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7498889567-kj7pg_88698f1b-e5e1-44da-9511-350e5916b6b8/kube-rbac-proxy-web/0.log"
Sep 11 16:37:47.876256 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.876234    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7498889567-kj7pg_88698f1b-e5e1-44da-9511-350e5916b6b8/kube-rbac-proxy/0.log"
Sep 11 16:37:47.909203 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.909181    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7498889567-kj7pg_88698f1b-e5e1-44da-9511-350e5916b6b8/prom-label-proxy/0.log"
Sep 11 16:37:47.959580 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.959557    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7498889567-kj7pg_88698f1b-e5e1-44da-9511-350e5916b6b8/kube-rbac-proxy-rules/0.log"
Sep 11 16:37:47.990013 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:47.989977    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7498889567-kj7pg_88698f1b-e5e1-44da-9511-350e5916b6b8/kube-rbac-proxy-metrics/0.log"
Sep 11 16:37:48.053966 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.053935    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"]
Sep 11 16:37:48.057854 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.057785    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.060483 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.060456    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jh25b\"/\"default-dockercfg-t8w88\""
Sep 11 16:37:48.060635 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.060457    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh25b\"/\"openshift-service-ca.crt\""
Sep 11 16:37:48.061714 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.061694    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jh25b\"/\"kube-root-ca.crt\""
Sep 11 16:37:48.066615 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.066590    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"]
Sep 11 16:37:48.150120 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.150086    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-proc\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.150529 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.150194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8j8t\" (UniqueName: \"kubernetes.io/projected/d47bad44-85d0-46a6-a984-a86e6afc4171-kube-api-access-d8j8t\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.150529 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.150217    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-podres\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.150529 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.150233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-sys\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.150529 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.150303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-lib-modules\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.250805 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.250749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-proc\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251007 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.250880    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-proc\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251007 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.250882    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8j8t\" (UniqueName: \"kubernetes.io/projected/d47bad44-85d0-46a6-a984-a86e6afc4171-kube-api-access-d8j8t\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251007 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.250988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-podres\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.251011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-sys\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.251028    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-lib-modules\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.251133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-sys\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.251165    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-podres\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.251207 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.251193    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d47bad44-85d0-46a6-a984-a86e6afc4171-lib-modules\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.260560 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.260538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8j8t\" (UniqueName: \"kubernetes.io/projected/d47bad44-85d0-46a6-a984-a86e6afc4171-kube-api-access-d8j8t\") pod \"perf-node-gather-daemonset-4vl72\" (UID: \"d47bad44-85d0-46a6-a984-a86e6afc4171\") " pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.368916 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.368828    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:48.640368 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:48.640343    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"]
Sep 11 16:37:48.642884 ip-10-0-130-241 kubenswrapper[2557]: W0911 16:37:48.642856    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd47bad44_85d0_46a6_a984_a86e6afc4171.slice/crio-a6b09f3e77031a9091aca8f329c88cb96ee4e8b5666a9f24d04193ddd87efbf9 WatchSource:0}: Error finding container a6b09f3e77031a9091aca8f329c88cb96ee4e8b5666a9f24d04193ddd87efbf9: Status 404 returned error can't find the container with id a6b09f3e77031a9091aca8f329c88cb96ee4e8b5666a9f24d04193ddd87efbf9
Sep 11 16:37:49.014161 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:49.014039    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72" event={"ID":"d47bad44-85d0-46a6-a984-a86e6afc4171","Type":"ContainerStarted","Data":"df250d1b8fb194617926ca319b1c0ac07a86562aecf5b4b9ecd4d22b6330594f"}
Sep 11 16:37:49.014161 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:49.014127    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:49.014161 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:49.014147    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72" event={"ID":"d47bad44-85d0-46a6-a984-a86e6afc4171","Type":"ContainerStarted","Data":"a6b09f3e77031a9091aca8f329c88cb96ee4e8b5666a9f24d04193ddd87efbf9"}
Sep 11 16:37:49.226410 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:49.226377    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-rmnc6_3b901584-7eea-45e7-8a42-3dc8d3d18210/networking-console-plugin/0.log"
Sep 11 16:37:50.430365 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:50.430326    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-pcn48_f4a24858-2fd5-45d7-a9f2-e2ff782acbca/download-server/0.log"
Sep 11 16:37:52.290304 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:52.290277    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4v2m_efcfec48-1d15-49cd-bb60-b691f8cfa9b3/dns/0.log"
Sep 11 16:37:52.316414 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:52.316386    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-g4v2m_efcfec48-1d15-49cd-bb60-b691f8cfa9b3/kube-rbac-proxy/0.log"
Sep 11 16:37:52.503857 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:52.503831    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-npr6z_c5cf08d1-4023-4d0f-b38d-35ba5889a90f/dns-node-resolver/0.log"
Sep 11 16:37:53.346862 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:53.346833    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77b995bb69-62jpz_b862348e-fb95-4442-ba3d-f421890b0edc/registry/0.log"
Sep 11 16:37:53.443627 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:53.443596    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6zfb_70ef2110-78b6-4ecd-b9be-199eb5bee58b/node-ca/0.log"
Sep 11 16:37:54.721005 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:54.720974    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc_4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35/istio-proxy/0.log"
Sep 11 16:37:55.028672 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.028594    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72"
Sep 11 16:37:55.051206 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.051180    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k55b7_ab138496-5ed2-4435-b4cb-9dc91c65ab06/discovery/0.log"
Sep 11 16:37:55.063288 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.063245    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jh25b/perf-node-gather-daemonset-4vl72" podStartSLOduration=7.063231117 podStartE2EDuration="7.063231117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:49.036961266 +0000 UTC m=+2132.587149118" watchObservedRunningTime="2026-09-11 16:37:55.063231117 +0000 UTC m=+2138.613418969"
Sep 11 16:37:55.330751 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.330719    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/0.log"
Sep 11 16:37:55.336852 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.336826    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/1.log"
Sep 11 16:37:55.501599 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.501567    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sgpws_04eac8d5-8c67-44e5-9b04-44f2c7693dac/payload-processing/0.log"
Sep 11 16:37:55.569982 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:55.569956    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-769b995cc4-mf8xv_e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709/router/0.log"
Sep 11 16:37:57.396527 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:57.396495    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpqst_1d74b7d8-e76a-4b61-8059-3f210cbc9087/serve-healthcheck-canary/0.log"
Sep 11 16:37:59.704621 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:59.704591    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc_4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35/istio-proxy/0.log"
Sep 11 16:37:59.898383 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:37:59.898345    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s9pmn_c029a75a-d221-4913-9758-e5cffc9a3e04/kube-rbac-proxy/0.log"
Sep 11 16:38:00.010140 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.010113    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s9pmn_c029a75a-d221-4913-9758-e5cffc9a3e04/exporter/0.log"
Sep 11 16:38:00.038331 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.038292    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k55b7_ab138496-5ed2-4435-b4cb-9dc91c65ab06/discovery/0.log"
Sep 11 16:38:00.127489 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.127461    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s9pmn_c029a75a-d221-4913-9758-e5cffc9a3e04/extractor/0.log"
Sep 11 16:38:00.180239 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.180145    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/0.log"
Sep 11 16:38:00.186832 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.186808    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/1.log"
Sep 11 16:38:00.326109 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.326080    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sgpws_04eac8d5-8c67-44e5-9b04-44f2c7693dac/payload-processing/0.log"
Sep 11 16:38:00.415746 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:00.415719    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-769b995cc4-mf8xv_e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709/router/0.log"
Sep 11 16:38:02.408281 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:02.408198    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-5fngc_4208f9d0-e1f1-4f63-b2ea-452a2cbbfc35/istio-proxy/0.log"
Sep 11 16:38:02.737122 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:02.737020    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k55b7_ab138496-5ed2-4435-b4cb-9dc91c65ab06/discovery/0.log"
Sep 11 16:38:03.171664 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:03.171637    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/0.log"
Sep 11 16:38:03.177719 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:03.177697    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b7nfd_0c1daf0b-7ec7-4f21-9d92-1e45bff4f28d/istio-proxy/1.log"
Sep 11 16:38:03.322526 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:03.322497    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-sgpws_04eac8d5-8c67-44e5-9b04-44f2c7693dac/payload-processing/0.log"
Sep 11 16:38:03.387789 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:03.387759    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-769b995cc4-mf8xv_e7e34c2b-f6a4-4287-aa8a-f7caa9bb7709/router/0.log"
Sep 11 16:38:04.221524 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:04.221493    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c667ccddd-pqpd4_8df82528-a3b5-4762-8a1f-1cda82e6bda8/manager/0.log"
Sep 11 16:38:04.222100 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:04.222085    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c667ccddd-pqpd4_8df82528-a3b5-4762-8a1f-1cda82e6bda8/manager/1.log"
Sep 11 16:38:05.486777 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:05.486749    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-j2b7j_ad188a88-f33a-4e73-92ee-216fb4f1993b/manager/0.log"
Sep 11 16:38:05.613099 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:05.613072    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-58649dcd54-j2b7j_ad188a88-f33a-4e73-92ee-216fb4f1993b/copy-manifests/0.log"
Sep 11 16:38:08.025987 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:08.025952    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d9ffdf556-fg2nw_e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3/manager/2.log"
Sep 11 16:38:08.026397 ip-10-0-130-241 kubenswrapper[2557]: I0911 16:38:08.026314    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d9ffdf556-fg2nw_e8d3bfdb-9b37-4a2c-9e99-0b8ca5decbd3/manager/1.log"