Sep 12 02:36:07.639682 ip-10-0-141-22 systemd[1]: Starting Kubernetes Kubelet...
Sep 12 02:36:07.991332 ip-10-0-141-22 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 02:36:07.991332 ip-10-0-141-22 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 12 02:36:07.991332 ip-10-0-141-22 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 02:36:07.991332 ip-10-0-141-22 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 12 02:36:07.991332 ip-10-0-141-22 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 12 02:36:07.993894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:07.993814    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 12 02:36:07.999977 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:07.999945    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 02:36:07.999977 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:07.999977    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:07.999987    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000001    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000009    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000016    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000022    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000029    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000036    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000044    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000052    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000060    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000082    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000090    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 02:36:08.000102 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000096    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000108    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000116    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000124    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000131    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000139    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000147    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000155    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000162    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000169    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000175    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000182    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000188    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000205    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000214    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000221    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000228    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000235    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000242    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000248    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 02:36:08.000428 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000255    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000260    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000265    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000269    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000274    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000278    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000290    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000295    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000299    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000304    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000307    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000310    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000313    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000316    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000319    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000322    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000325    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000327    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000333    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000336    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 02:36:08.000918 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000339    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000449    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000454    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000459    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000463    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000467    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000469    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000472    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000475    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000478    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000480    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000483    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000486    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000488    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000491    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000494    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000496    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000499    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000501    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 02:36:08.001419 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000504    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000508    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000511    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000514    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000516    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000519    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000522    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000525    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000527    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000530    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000535    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000539    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000542    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000546    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000549    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000553    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000555    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000558    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000561    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 02:36:08.001887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000563    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000566    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000568    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000571    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000573    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000576    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.000578    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001313    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001320    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001323    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001325    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001328    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001331    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001333    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001336    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001338    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001343    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001348    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001351    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 02:36:08.002363 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001355    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001358    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001361    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001364    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001367    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001376    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001379    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001382    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001385    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001387    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001389    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001392    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001394    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001397    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001400    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001419    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001423    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001425    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001428    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 02:36:08.002881 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001431    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001433    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001436    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001438    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001441    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001443    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001446    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001449    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001451    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001460    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001463    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001466    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001468    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001472    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001475    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001478    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001481    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001483    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001486    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001494    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 02:36:08.003359 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001497    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001499    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001502    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001504    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001507    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001509    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001512    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001515    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001517    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001519    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001522    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001524    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001527    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001530    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001532    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001536    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001538    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001541    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001543    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001546    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 02:36:08.003887 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001548    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001551    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001554    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001556    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001559    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001561    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001565    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001569    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001573    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001577    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001580    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001583    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001592    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001595    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001598    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001600    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001607    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001610    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001613    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 02:36:08.004378 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001615    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001618    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001620    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001623    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001626    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001628    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001631    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001633    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.001636    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002049    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002054    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002057    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002059    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002062    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002065    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002068    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002071    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002073    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002076    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002079    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 02:36:08.004866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002082    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002086    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002098    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002103    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002106    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002114    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002117    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002120    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002122    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002125    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002127    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002130    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002133    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002135    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002138    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002140    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002143    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002145    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002148    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 02:36:08.005344 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002150    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002153    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002155    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002158    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002160    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002163    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002165    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002168    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002171    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002174    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002176    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002179    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002182    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002185    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002187    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002190    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002192    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002195    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002198    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002207    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 02:36:08.005825 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002210    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002212    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002215    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002217    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002221    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002224    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002226    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002228    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002231    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002235    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002238    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002241    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002243    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002246    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002249    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002252    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002255    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002257    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002260    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002263    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 02:36:08.006325 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002266    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002268    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002271    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002275    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002278    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002281    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002283    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002286    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002290    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002293    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002296    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002299    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002307    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002310    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002312    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002315    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002318    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002321    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002323    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002326    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 02:36:08.006832 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002328    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002331    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002333    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002335    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002338    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002340    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002343    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002345    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.002348    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002439    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002474    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002483    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002488    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002492    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002495    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002500    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002507    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002510    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002513    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002516    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002519    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002522    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 12 02:36:08.007398 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002526    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002528    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002531    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002541    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002545    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002552    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002555    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002557    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002560    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002564    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002567    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002570    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002573    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002577    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002580    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002583    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002586    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002589    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002592    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002596    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002599    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002602    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002605    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002608    2583 flags.go:64] FLAG: --enable-server="true"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002610    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 12 02:36:08.008009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002617    2583 flags.go:64] FLAG: --event-burst="100"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002621    2583 flags.go:64] FLAG: --event-qps="50"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002624    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002627    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002630    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002634    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002637    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002640    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002642    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002645    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002648    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002656    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002659    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002663    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002665    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002668    2583 flags.go:64] FLAG: --feature-gates=""
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002672    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002675    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002678    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002681    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002684    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002687    2583 flags.go:64] FLAG: --help="false"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002690    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002693    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 12 02:36:08.008638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002695    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002698    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002701    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002705    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002707    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002710    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002713    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002716    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002718    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002723    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002726    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002729    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002731    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002734    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002737    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002740    2583 flags.go:64] FLAG: --lock-file=""
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002742    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002745    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002748    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002753    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002762    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002765    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002768    2583 flags.go:64] FLAG: --logging-format="text"
Sep 12 02:36:08.009242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002770    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002774    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002776    2583 flags.go:64] FLAG: --manifest-url=""
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002779    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002783    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002786    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002790    2583 flags.go:64] FLAG: --max-pods="110"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002793    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002795    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002798    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002801    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002804    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002806    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002809    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002816    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002820    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002823    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002826    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002830    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002836    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002839    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002842    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002845    2583 flags.go:64] FLAG: --port="10250"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002848    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 12 02:36:08.009820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002850    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075be9e1e5d3225e9"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002854    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002857    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002859    2583 flags.go:64] FLAG: --register-node="true"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002862    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002866    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002874    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002877    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002880    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002884    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002887    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002890    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002893    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002896    2583 flags.go:64] FLAG: --runonce="false"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002899    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002902    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002905    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002908    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002910    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002914    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002917    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002920    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002922    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002925    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002929    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002932    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 12 02:36:08.010478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002935    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002939    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002942    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002948    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002951    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002954    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002959    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002961    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002964    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002967    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002970    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002973    2583 flags.go:64] FLAG: --v="2"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002977    2583 flags.go:64] FLAG: --version="false"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002981    2583 flags.go:64] FLAG: --vmodule=""
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002986    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.002989    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003104    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003108    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003112    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003115    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003118    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003121    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003123    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 02:36:08.011121 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003126    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003129    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003132    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003135    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003138    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003140    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003143    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003147    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003149    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003152    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003156    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003159    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003161    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003164    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003166    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003169    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003171    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003174    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003177    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003179    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 02:36:08.011747 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003182    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003185    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003187    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003191    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003193    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003196    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003199    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003201    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003205    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003208    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003211    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003214    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003216    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003218    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003221    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003223    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003227    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003231    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003234    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 02:36:08.012235 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003238    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003240    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003243    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003248    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003250    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003253    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003255    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003258    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003261    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003263    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003266    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003269    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003271    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003274    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003276    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003279    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003281    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003284    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003287    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003289    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 02:36:08.012719 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003292    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003295    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003297    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003300    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003302    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003305    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003307    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003310    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003312    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003315    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003317    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003320    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003324    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003326    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003329    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003333    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003335    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003338    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003340    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003343    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 02:36:08.013234 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003346    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003350    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003353    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003356    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003359    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003362    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003365    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003368    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003371    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003374    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003377    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003380    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.003382    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.003390    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010001    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 12 02:36:08.013753 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010017    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010036    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010042    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010105    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010111    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010114    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010117    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010120    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010123    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010126    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010130    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010133    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010135    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010138    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010142    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010145    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010148    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010150    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010154    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 02:36:08.014145 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010158    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010161    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010165    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010167    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010170    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010174    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010177    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010180    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010182    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010185    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010188    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010190    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010193    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010197    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010199    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010202    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010205    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010207    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010210    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 02:36:08.014646 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010213    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010215    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010218    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010221    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010223    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010226    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010229    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010231    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010234    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010236    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010239    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010242    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010246    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010249    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010252    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010255    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010257    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010260    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010262    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010265    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 02:36:08.015154 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010268    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010270    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010273    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010275    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010278    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010280    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010283    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010286    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010289    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010291    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010294    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010296    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010299    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010301    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010304    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010306    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010309    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010311    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010314    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010316    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 02:36:08.015663 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010319    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010321    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010323    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010326    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010328    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010332    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010336    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010339    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010342    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010344    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010347    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010350    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010352    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010355    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010357    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010360    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010363    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010365    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010368    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 02:36:08.016151 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010370    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010373    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010376    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010378    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010381    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010386    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010509    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010514    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010517    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010520    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010523    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010525    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010528    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010530    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010533    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 12 02:36:08.016641 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010535    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010538    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010540    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010543    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010545    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010549    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010553    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010556    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010558    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010561    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010564    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010566    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010569    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010572    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010574    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010577    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010579    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010582    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010585    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 12 02:36:08.017012 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010589    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010592    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010595    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010598    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010600    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010603    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010606    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010608    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010611    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010613    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010616    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010618    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010621    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010623    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010626    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010628    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010631    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010634    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010636    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010638    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 12 02:36:08.017587 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010641    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010644    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010647    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010650    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010652    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010655    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010657    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010660    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010662    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010665    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010667    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010670    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010673    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010676    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010678    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010681    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010684    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010686    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010689    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 12 02:36:08.018082 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010692    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010694    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010698    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010701    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010704    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010706    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010709    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010712    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010715    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010718    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010723    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010726    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010729    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010732    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010734    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010737    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010740    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010742    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010745    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010748    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 12 02:36:08.018577 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010750    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010753    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010755    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010758    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010761    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010763    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010765    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010768    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010771    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010774    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010776    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:08.010779    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010784    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.010884    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 12 02:36:08.019060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.012813    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 12 02:36:08.019394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.013678    2583 server.go:1019] "Starting client certificate rotation"
Sep 12 02:36:08.019394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.013773    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 12 02:36:08.019394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.013809    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 12 02:36:08.019394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.016472    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 12 02:36:08.019394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.019059    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 12 02:36:08.027088 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.027071    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 12 02:36:08.032042 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.032022    2583 log.go:25] "Validated CRI v1 image API"
Sep 12 02:36:08.032767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.032751    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 12 02:36:08.035289 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.035272    2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae7cdf92-5c91-4609-b48b-2dbb6cd7f904:/dev/nvme0n1p4 dbbdb83e-6fc6-4b49-925d-6e8e16abb4b4:/dev/nvme0n1p3]
Sep 12 02:36:08.035347 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.035289    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 12 02:36:08.040277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.040169    2583 manager.go:216] Machine: {Timestamp:2026-09-12 02:36:08.038893242 +0000 UTC m=+0.294874248 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099224 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24cddd5b3fc46716b6140ffe81753b SystemUUID:ec24cddd-5b3f-c467-16b6-140ffe81753b BootID:d33a0740-311c-4c43-8c91-6817c7c51928 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0b:a1:83:90:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0b:a1:83:90:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:6e:15:39:94:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 12 02:36:08.040277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.040270    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 12 02:36:08.040395 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.040338    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 12 02:36:08.042838 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.042810    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 12 02:36:08.042964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.042840    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 12 02:36:08.043101 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.043084    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 12 02:36:08.044210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.044198    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 12 02:36:08.044210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.044212    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 12 02:36:08.044285 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.044219    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 12 02:36:08.044285 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.044229    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 12 02:36:08.045246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.045236    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 12 02:36:08.047718 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047707    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 12 02:36:08.047825 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047816    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 12 02:36:08.047860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047842    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 12 02:36:08.047860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047852    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 12 02:36:08.047914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047861    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 12 02:36:08.047914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047870    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 12 02:36:08.047914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.047880    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 12 02:36:08.048247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.048234    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 12 02:36:08.048292 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.048260    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 12 02:36:08.050221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.050204    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 12 02:36:08.052248 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.052235    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 12 02:36:08.052300 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.052265    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 12 02:36:08.053613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053598    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 12 02:36:08.053665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053622    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 12 02:36:08.053665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053631    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 12 02:36:08.053665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053639    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 12 02:36:08.053665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053648    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 12 02:36:08.053665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053653    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 12 02:36:08.053665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053665    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053670    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053676    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053682    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053694    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053700    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053721    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 12 02:36:08.053948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.053726    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 12 02:36:08.057304 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.057289    2583 server.go:1268] "Started kubelet"
Sep 12 02:36:08.057427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.057395    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 12 02:36:08.057518 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.057492    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 12 02:36:08.057627 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.057514    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 12 02:36:08.057627 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.057530    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 12 02:36:08.057627 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.057539    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 12 02:36:08.057627 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.057608    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 12 02:36:08.058242 ip-10-0-141-22 systemd[1]: Started Kubernetes Kubelet.
Sep 12 02:36:08.059004 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.058987    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 12 02:36:08.060353 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.060340    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 12 02:36:08.063171 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.062286    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-22.ec2.internal.18d4723f4615acac  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-22.ec2.internal,UID:ip-10-0-141-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-22.ec2.internal,},FirstTimestamp:2026-09-12 02:36:08.057261228 +0000 UTC m=+0.313242284,LastTimestamp:2026-09-12 02:36:08.057261228 +0000 UTC m=+0.313242284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-22.ec2.internal,}"
Sep 12 02:36:08.064272 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.064253    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 12 02:36:08.064746 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.064731    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 12 02:36:08.065290 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.065262    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.065927 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.065554    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 12 02:36:08.065927 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.065723    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 12 02:36:08.066370 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066341    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tq29g"
Sep 12 02:36:08.066465 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066419    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 12 02:36:08.066465 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066429    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 12 02:36:08.066573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066493    2583 factory.go:55] Registering systemd factory
Sep 12 02:36:08.066573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066509    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 12 02:36:08.066573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066560    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 12 02:36:08.066573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.066569    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 12 02:36:08.067554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.067536    2583 factory.go:153] Registering CRI-O factory
Sep 12 02:36:08.067619 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.067554    2583 factory.go:223] Registration of the crio container factory successfully
Sep 12 02:36:08.067684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.067632    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 12 02:36:08.067684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.067646    2583 factory.go:103] Registering Raw factory
Sep 12 02:36:08.067684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.067663    2583 manager.go:1196] Started watching for new ooms in manager
Sep 12 02:36:08.068747 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.068730    2583 manager.go:349] Starting recovery of all containers
Sep 12 02:36:08.070324 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.070297    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 12 02:36:08.070440 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.070423    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 12 02:36:08.073460 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.073399    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tq29g"
Sep 12 02:36:08.080214 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.080065    2583 manager.go:354] Recovery completed
Sep 12 02:36:08.086558 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.086544    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.088139 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088126    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.088213 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088157    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.088213 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088173    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.088671 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088659    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 12 02:36:08.088671 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088670    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 12 02:36:08.088776 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088684    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 12 02:36:08.088776 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.088662    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.089338 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.089324    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.089389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.089348    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.089389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.089357    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.089880 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.089864    2583 policy_none.go:49] "None policy: Start"
Sep 12 02:36:08.089953 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.089884    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 12 02:36:08.089953 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.089897    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 12 02:36:08.090431 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.090357    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-22.ec2.internal.18d4723f47ecd8f1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-22.ec2.internal,UID:ip-10-0-141-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-22.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-22.ec2.internal,},FirstTimestamp:2026-09-12 02:36:08.088140017 +0000 UTC m=+0.344121025,LastTimestamp:2026-09-12 02:36:08.088140017 +0000 UTC m=+0.344121025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-22.ec2.internal,}"
Sep 12 02:36:08.090990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.090978    2583 policy_none.go:47] "Start"
Sep 12 02:36:08.125926 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.125913    2583 manager.go:337] "Starting Device Plugin manager"
Sep 12 02:36:08.126027 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.125945    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 12 02:36:08.126027 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.125955    2583 server.go:87] "Starting device plugin registration server"
Sep 12 02:36:08.126224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.126210    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 12 02:36:08.126316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.126223    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 12 02:36:08.126371 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.126341    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 12 02:36:08.126438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.126427    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 12 02:36:08.126438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.126437    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 12 02:36:08.126912 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.126892    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 12 02:36:08.126990 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.126945    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.152427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.152387    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 12 02:36:08.153600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.153581    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 12 02:36:08.154214 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.154200    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 12 02:36:08.154284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.154235    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 12 02:36:08.154338 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.154303    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 12 02:36:08.156071 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.156052    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 02:36:08.226343 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.226312    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.227161 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.227144    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.227223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.227179    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.227223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.227193    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.227223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.227218    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.235277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.235260    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.235348 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.235281    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-22.ec2.internal\": node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.252163 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.252097    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.256058 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.255289    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"]
Sep 12 02:36:08.256144 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.256091    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.256820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.256806    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.256877 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.256832    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.256877 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.256842    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.258046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258035    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.258173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258160    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.258230 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258191    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.258680 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258662    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.258758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258685    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.258758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258709    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.258758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258721    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.258758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258690    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.258888 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.258767    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.260832 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.260818    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.260890 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.260848    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 12 02:36:08.261499 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.261475    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientMemory"
Sep 12 02:36:08.261499 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.261498    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasNoDiskPressure"
Sep 12 02:36:08.261610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.261511    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeHasSufficientPID"
Sep 12 02:36:08.268019 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.268003    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63281233adfc708d92a6c41e2612bf0d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-22.ec2.internal\" (UID: \"63281233adfc708d92a6c41e2612bf0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.268102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.268033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5b0e3f2dc83ed2abd172e86e7c42146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"b5b0e3f2dc83ed2abd172e86e7c42146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.268102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.268057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b0e3f2dc83ed2abd172e86e7c42146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"b5b0e3f2dc83ed2abd172e86e7c42146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.280923 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.280901    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-22.ec2.internal\" not found" node="ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.285318 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.285304    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-22.ec2.internal\" not found" node="ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.352553 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.352536    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.368537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.368512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63281233adfc708d92a6c41e2612bf0d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-22.ec2.internal\" (UID: \"63281233adfc708d92a6c41e2612bf0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.368625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.368543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5b0e3f2dc83ed2abd172e86e7c42146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"b5b0e3f2dc83ed2abd172e86e7c42146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.368625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.368568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b0e3f2dc83ed2abd172e86e7c42146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"b5b0e3f2dc83ed2abd172e86e7c42146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.368625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.368620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b0e3f2dc83ed2abd172e86e7c42146-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"b5b0e3f2dc83ed2abd172e86e7c42146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.368737 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.368624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/63281233adfc708d92a6c41e2612bf0d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-22.ec2.internal\" (UID: \"63281233adfc708d92a6c41e2612bf0d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.368737 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.368623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5b0e3f2dc83ed2abd172e86e7c42146-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal\" (UID: \"b5b0e3f2dc83ed2abd172e86e7c42146\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.452632 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.452597    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.553348 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.553300    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.582860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.582843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.588268 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.588251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.653627 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.653606    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.754130 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.754105    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.854612 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:08.854547    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-22.ec2.internal\" not found"
Sep 12 02:36:08.877158 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.877142    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 02:36:08.966697 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.966670    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.975658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.975636    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 12 02:36:08.977147 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.977135    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal"
Sep 12 02:36:08.985567 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:08.985548    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 12 02:36:09.013714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.013693    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 12 02:36:09.014233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.013833    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 12 02:36:09.014233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.013867    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 12 02:36:09.049087 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.049064    2583 apiserver.go:52] "Watching apiserver"
Sep 12 02:36:09.065112 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.065090    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 12 02:36:09.066032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.066015    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 12 02:36:09.066387 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.066363    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-kd44x","kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jx4ln","openshift-dns/node-resolver-gm5gm","openshift-multus/multus-l4lzt","openshift-network-diagnostics/network-check-target-5jbch","openshift-network-operator/iptables-alerter-54vpd","openshift-ovn-kubernetes/ovnkube-node-9lx45","kube-system/global-pull-secret-syncer-lrrtt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz","openshift-image-registry/node-ca-zg9wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal","openshift-multus/multus-additional-cni-plugins-49mpg","openshift-multus/network-metrics-daemon-vt47l"]
Sep 12 02:36:09.068199 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.068181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.069850 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.069829    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.071131 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.071112    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.071383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.071201    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.071383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.071215    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 12 02:36:09.071383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.071233    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hthdg\""
Sep 12 02:36:09.071383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.071254    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.072363 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072344    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.072447 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072384    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 12 02:36:09.072447 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072386    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qtdnk\""
Sep 12 02:36:09.072607 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072455    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.072746 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 12 02:36:09.072746 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072733    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 12 02:36:09.072846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.072789    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.074360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.073980    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.074360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.073989    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.074360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.074072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xvns8\""
Sep 12 02:36:09.074759 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.073986    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.076344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.075587    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p2rbf\""
Sep 12 02:36:09.076344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.075665    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.076344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.075836    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.076344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.076224    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-11 02:31:08 +0000 UTC" deadline="2028-02-28 21:33:11.940496085 +0000 UTC"
Sep 12 02:36:09.076344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.076268    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12834h57m2.864231404s"
Sep 12 02:36:09.076786 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.076763    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:09.076912 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.076890    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:09.077912 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.077893    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 12 02:36:09.078095 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.078072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s4stj\""
Sep 12 02:36:09.078596 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.078571    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 12 02:36:09.078768 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.078755    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.078823 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.078808    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:09.080342 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.080320    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.082255 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.082240    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.082331 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.082317    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:09.082637 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.082604    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dz99t\""
Sep 12 02:36:09.082726 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.082711    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 12 02:36:09.082799 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.082781    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 12 02:36:09.084408 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.084389    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.086586 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.086565    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.086734 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.086715    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 12 02:36:09.086916 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.086885    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.086916 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.086887    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.087062 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.086941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bbmph\""
Sep 12 02:36:09.089172 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.089153    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.089172 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.089170    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 12 02:36:09.089332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.089182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.089391 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.089328    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.089391 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.089347    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zv8jm\""
Sep 12 02:36:09.091595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.091576    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 12 02:36:09.092400 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.092110    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 12 02:36:09.092400 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.092207    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-29tld\""
Sep 12 02:36:09.092677 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.092621    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 12 02:36:09.099039 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.099014    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 12 02:36:09.099145 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.099083    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 12 02:36:09.099210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.099151    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 12 02:36:09.100215 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.100198    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nmqn5"
Sep 12 02:36:09.101195 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.101163    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b0e3f2dc83ed2abd172e86e7c42146.slice/crio-56e741319a8299874be760eede9042871981b295c1ef7e47dc0f90a4591be6db WatchSource:0}: Error finding container 56e741319a8299874be760eede9042871981b295c1ef7e47dc0f90a4591be6db: Status 404 returned error can't find the container with id 56e741319a8299874be760eede9042871981b295c1ef7e47dc0f90a4591be6db
Sep 12 02:36:09.106115 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.106068    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63281233adfc708d92a6c41e2612bf0d.slice/crio-04df4bda27151573b30a99b8d2c8fd818995fd7b2aa8f9f7b2e019b94f9f063a WatchSource:0}: Error finding container 04df4bda27151573b30a99b8d2c8fd818995fd7b2aa8f9f7b2e019b94f9f063a: Status 404 returned error can't find the container with id 04df4bda27151573b30a99b8d2c8fd818995fd7b2aa8f9f7b2e019b94f9f063a
Sep 12 02:36:09.108782 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.108763    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nmqn5"
Sep 12 02:36:09.108839 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.108818    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 02:36:09.121862 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.121843    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 02:36:09.157535 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.157494    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" event={"ID":"63281233adfc708d92a6c41e2612bf0d","Type":"ContainerStarted","Data":"04df4bda27151573b30a99b8d2c8fd818995fd7b2aa8f9f7b2e019b94f9f063a"}
Sep 12 02:36:09.158757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.158734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" event={"ID":"b5b0e3f2dc83ed2abd172e86e7c42146","Type":"ContainerStarted","Data":"56e741319a8299874be760eede9042871981b295c1ef7e47dc0f90a4591be6db"}
Sep 12 02:36:09.166613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.166598    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 12 02:36:09.172074 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172055    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-socket-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.172129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172082    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-run-netns\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172121    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-log-socket\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovn-node-metrics-cert\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172159    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysctl-conf\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-var-lib-kubelet\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-iptables-alerter-script\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmdl\" (UniqueName: \"kubernetes.io/projected/e53f21b4-07f9-4896-b92b-a3e17b586675-kube-api-access-2jmdl\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.172261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172250    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-etc-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-tmp\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-system-cni-dir\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172310    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-cni-binary-copy\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfgkt\" (UniqueName: \"kubernetes.io/projected/01fa6190-8c9c-47de-b592-3c42d9219593-kube-api-access-cfgkt\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172370    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysctl-d\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65fb995-c074-4c75-8709-e11ad8ddd764-tmp-dir\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91392b24-b012-4866-bbae-09944d2051f6-konnectivity-ca\") pod \"konnectivity-agent-kd44x\" (UID: \"91392b24-b012-4866-bbae-09944d2051f6\") " pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-ovn\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsk6j\" (UniqueName: \"kubernetes.io/projected/35f5028d-d42b-49c2-84fb-0c297c87cee1-kube-api-access-vsk6j\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-system-cni-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.172534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-k8s-cni-cncf-io\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172551    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91392b24-b012-4866-bbae-09944d2051f6-agent-certs\") pod \"konnectivity-agent-kd44x\" (UID: \"91392b24-b012-4866-bbae-09944d2051f6\") " pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172565    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-device-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovnkube-config\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07438c10-c798-4c41-adbc-7cb89858375e-kubelet-config\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-kubelet\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-daemon-config\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-multus-certs\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-etc-kubernetes\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20f66744-7567-4321-a774-8b0c260e5477-serviceca\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172862    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-kubelet\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172885    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysconfig\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-cni-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172951    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-conf-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-sys-fs\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.172993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-env-overrides\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6tt\" (UniqueName: \"kubernetes.io/projected/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-kube-api-access-vk6tt\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173023    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-host-slash\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-cni-bin\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-systemd\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-tuned\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173170    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-cnibin\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173214    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d9cdbc-b067-4f22-83ae-1917b30f4525-cni-binary-copy\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-netns\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173290    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-registration-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-run-ovn-kubernetes\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-run\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.173655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173367    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwb9h\" (UniqueName: \"kubernetes.io/projected/79a51ccb-246e-44da-9d05-ec1c2a395d1a-kube-api-access-fwb9h\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-cni-multus\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-etc-selinux\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-node-log\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173492    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovnkube-script-lib\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e65fb995-c074-4c75-8709-e11ad8ddd764-hosts-file\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07438c10-c798-4c41-adbc-7cb89858375e-dbus\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-socket-dir-parent\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwtkv\" (UniqueName: \"kubernetes.io/projected/20f66744-7567-4321-a774-8b0c260e5477-kube-api-access-xwtkv\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-systemd\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-modprobe-d\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-sys\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-lib-modules\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmdjt\" (UniqueName: \"kubernetes.io/projected/d5d9cdbc-b067-4f22-83ae-1917b30f4525-kube-api-access-cmdjt\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20f66744-7567-4321-a774-8b0c260e5477-host\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-kubernetes\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-cni-bin\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.174284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-hostroot\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173770    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-cni-netd\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-host\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173813    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173836    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-cnibin\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-var-lib-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh86n\" (UniqueName: \"kubernetes.io/projected/e65fb995-c074-4c75-8709-e11ad8ddd764-kube-api-access-jh86n\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw98f\" (UniqueName: \"kubernetes.io/projected/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-kube-api-access-jw98f\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173952    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-systemd-units\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.174835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.173976    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-slash\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274211 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-log-socket\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovn-node-metrics-cert\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysctl-conf\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.274316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-var-lib-kubelet\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-log-socket\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysctl-conf\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-iptables-alerter-script\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274396    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-var-lib-kubelet\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmdl\" (UniqueName: \"kubernetes.io/projected/e53f21b4-07f9-4896-b92b-a3e17b586675-kube-api-access-2jmdl\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-etc-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274499    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-tmp\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-system-cni-dir\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-etc-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-cni-binary-copy\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.274608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfgkt\" (UniqueName: \"kubernetes.io/projected/01fa6190-8c9c-47de-b592-3c42d9219593-kube-api-access-cfgkt\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysctl-d\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-system-cni-dir\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysctl-d\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65fb995-c074-4c75-8709-e11ad8ddd764-tmp-dir\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91392b24-b012-4866-bbae-09944d2051f6-konnectivity-ca\") pod \"konnectivity-agent-kd44x\" (UID: \"91392b24-b012-4866-bbae-09944d2051f6\") " pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274882    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-ovn\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsk6j\" (UniqueName: \"kubernetes.io/projected/35f5028d-d42b-49c2-84fb-0c297c87cee1-kube-api-access-vsk6j\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-system-cni-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274969    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-iptables-alerter-script\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.274977    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-k8s-cni-cncf-io\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91392b24-b012-4866-bbae-09944d2051f6-agent-certs\") pod \"konnectivity-agent-kd44x\" (UID: \"91392b24-b012-4866-bbae-09944d2051f6\") " pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.275126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-device-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.275684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275660    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 12 02:36:09.275784 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275762    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65fb995-c074-4c75-8709-e11ad8ddd764-tmp-dir\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.275837 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.275894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275843    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovnkube-config\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.275894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275855    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-k8s-cni-cncf-io\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.275894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07438c10-c798-4c41-adbc-7cb89858375e-kubelet-config\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.276050 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.276050 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-kubelet\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.276144 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276114    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/91392b24-b012-4866-bbae-09944d2051f6-konnectivity-ca\") pod \"konnectivity-agent-kd44x\" (UID: \"91392b24-b012-4866-bbae-09944d2051f6\") " pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.276229 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.276279 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.275879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-system-cni-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.276373 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276351    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-cni-binary-copy\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.276727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-daemon-config\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.276822 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276793    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-kubelet\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.276886 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovnkube-config\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.276886 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276852    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07438c10-c798-4c41-adbc-7cb89858375e-kubelet-config\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.276994 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.276994 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276909    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-device-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.276994 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.276965    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-daemon-config\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-ovn\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.277193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.277193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-multus-certs\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-etc-kubernetes\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20f66744-7567-4321-a774-8b0c260e5477-serviceca\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-kubelet\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysconfig\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-multus-certs\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277370    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-cni-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277382    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-etc-kubernetes\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-kubelet\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277417    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-conf-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-sysconfig\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-sys-fs\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-cni-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277529    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-env-overrides\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277535    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-conf-dir\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-sys-fs\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6tt\" (UniqueName: \"kubernetes.io/projected/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-kube-api-access-vk6tt\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-host-slash\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.277821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-cni-bin\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277841    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-systemd\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-tuned\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-cnibin\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.277975    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d9cdbc-b067-4f22-83ae-1917b30f4525-cni-binary-copy\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-netns\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/20f66744-7567-4321-a774-8b0c260e5477-serviceca\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-registration-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-run-ovn-kubernetes\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278091    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-env-overrides\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278217    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-systemd\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-run-ovn-kubernetes\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.278386    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.278489    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:36:09.778456388 +0000 UTC m=+2.034437405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278479    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-cni-bin\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.278771 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.278573    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.278658    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:36:09.778641016 +0000 UTC m=+2.034622018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278701    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-cnibin\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-registration-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-host-slash\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278847    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-run-netns\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-run\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01fa6190-8c9c-47de-b592-3c42d9219593-tuning-conf-dir\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.278931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwb9h\" (UniqueName: \"kubernetes.io/projected/79a51ccb-246e-44da-9d05-ec1c2a395d1a-kube-api-access-fwb9h\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-cni-multus\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279037    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-etc-selinux\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-node-log\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279105    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovnkube-script-lib\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e65fb995-c074-4c75-8709-e11ad8ddd764-hosts-file\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279207    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07438c10-c798-4c41-adbc-7cb89858375e-dbus\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-socket-dir-parent\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-cni-multus\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-etc-selinux\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-node-log\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e65fb995-c074-4c75-8709-e11ad8ddd764-hosts-file\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279520    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07438c10-c798-4c41-adbc-7cb89858375e-dbus\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279198    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d9cdbc-b067-4f22-83ae-1917b30f4525-cni-binary-copy\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-multus-socket-dir-parent\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279640    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-run\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovnkube-script-lib\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwtkv\" (UniqueName: \"kubernetes.io/projected/20f66744-7567-4321-a774-8b0c260e5477-kube-api-access-xwtkv\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.279939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-tmp\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280048    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-systemd\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-modprobe-d\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280131    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/91392b24-b012-4866-bbae-09944d2051f6-agent-certs\") pod \"konnectivity-agent-kd44x\" (UID: \"91392b24-b012-4866-bbae-09944d2051f6\") " pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280187    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-run-systemd\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-sys\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-lib-modules\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmdjt\" (UniqueName: \"kubernetes.io/projected/d5d9cdbc-b067-4f22-83ae-1917b30f4525-kube-api-access-cmdjt\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.282845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20f66744-7567-4321-a774-8b0c260e5477-host\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-sys\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-lib-modules\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280460    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-kubernetes\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-cni-bin\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-hostroot\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280609    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-modprobe-d\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-cni-netd\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-cni-netd\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-host\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-kubernetes\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20f66744-7567-4321-a774-8b0c260e5477-host\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-cnibin\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280800    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-host-var-lib-cni-bin\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-var-lib-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280840    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh86n\" (UniqueName: \"kubernetes.io/projected/e65fb995-c074-4c75-8709-e11ad8ddd764-kube-api-access-jh86n\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-hostroot\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.283661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280938    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d9cdbc-b067-4f22-83ae-1917b30f4525-cnibin\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-var-lib-openvswitch\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.280994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-host\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw98f\" (UniqueName: \"kubernetes.io/projected/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-kube-api-access-jw98f\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281042    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-systemd-units\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-slash\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281106    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-socket-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-run-netns\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281221    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-run-netns\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281235    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-systemd-units\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281285    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35f5028d-d42b-49c2-84fb-0c297c87cee1-host-slash\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e53f21b4-07f9-4896-b92b-a3e17b586675-socket-dir\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.281395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/01fa6190-8c9c-47de-b592-3c42d9219593-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.281546    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.281566    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.281586    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.281688    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:36:09.781659759 +0000 UTC m=+2.037640779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:09.284497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.282392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-etc-tuned\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.285026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.283599    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35f5028d-d42b-49c2-84fb-0c297c87cee1-ovn-node-metrics-cert\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.285026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.284389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfgkt\" (UniqueName: \"kubernetes.io/projected/01fa6190-8c9c-47de-b592-3c42d9219593-kube-api-access-cfgkt\") pod \"multus-additional-cni-plugins-49mpg\" (UID: \"01fa6190-8c9c-47de-b592-3c42d9219593\") " pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.285026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.284515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmdl\" (UniqueName: \"kubernetes.io/projected/e53f21b4-07f9-4896-b92b-a3e17b586675-kube-api-access-2jmdl\") pod \"aws-ebs-csi-driver-node-kx9xz\" (UID: \"e53f21b4-07f9-4896-b92b-a3e17b586675\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.286376 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.286354    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6tt\" (UniqueName: \"kubernetes.io/projected/6a5d4bc3-6f21-4729-a523-c19bdd296eaa-kube-api-access-vk6tt\") pod \"tuned-jx4ln\" (UID: \"6a5d4bc3-6f21-4729-a523-c19bdd296eaa\") " pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.287774 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.287751    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 02:36:09.288304 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.288277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmdjt\" (UniqueName: \"kubernetes.io/projected/d5d9cdbc-b067-4f22-83ae-1917b30f4525-kube-api-access-cmdjt\") pod \"multus-l4lzt\" (UID: \"d5d9cdbc-b067-4f22-83ae-1917b30f4525\") " pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.288566 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.288476    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwtkv\" (UniqueName: \"kubernetes.io/projected/20f66744-7567-4321-a774-8b0c260e5477-kube-api-access-xwtkv\") pod \"node-ca-zg9wj\" (UID: \"20f66744-7567-4321-a774-8b0c260e5477\") " pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.288953 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.288931    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwb9h\" (UniqueName: \"kubernetes.io/projected/79a51ccb-246e-44da-9d05-ec1c2a395d1a-kube-api-access-fwb9h\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.289080 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.289062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsk6j\" (UniqueName: \"kubernetes.io/projected/35f5028d-d42b-49c2-84fb-0c297c87cee1-kube-api-access-vsk6j\") pod \"ovnkube-node-9lx45\" (UID: \"35f5028d-d42b-49c2-84fb-0c297c87cee1\") " pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.289297 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.289274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw98f\" (UniqueName: \"kubernetes.io/projected/6700e3f9-9a32-41f1-9bcc-4bddf7e31595-kube-api-access-jw98f\") pod \"iptables-alerter-54vpd\" (UID: \"6700e3f9-9a32-41f1-9bcc-4bddf7e31595\") " pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.289578 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.289558    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh86n\" (UniqueName: \"kubernetes.io/projected/e65fb995-c074-4c75-8709-e11ad8ddd764-kube-api-access-jh86n\") pod \"node-resolver-gm5gm\" (UID: \"e65fb995-c074-4c75-8709-e11ad8ddd764\") " pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.401070 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.401019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-54vpd"
Sep 12 02:36:09.407127 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.407106    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-49mpg"
Sep 12 02:36:09.412269 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.412247    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6700e3f9_9a32_41f1_9bcc_4bddf7e31595.slice/crio-8e73d452af7d11a745f1b9265e30273ed8a60b16799f9077f124929061979056 WatchSource:0}: Error finding container 8e73d452af7d11a745f1b9265e30273ed8a60b16799f9077f124929061979056: Status 404 returned error can't find the container with id 8e73d452af7d11a745f1b9265e30273ed8a60b16799f9077f124929061979056
Sep 12 02:36:09.413934 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.413765    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jx4ln"
Sep 12 02:36:09.416548 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.416525    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fa6190_8c9c_47de_b592_3c42d9219593.slice/crio-a6a7d239b7b6239539bd2acfc2cdc73995b2c6ac7daca574795c357a7216bafa WatchSource:0}: Error finding container a6a7d239b7b6239539bd2acfc2cdc73995b2c6ac7daca574795c357a7216bafa: Status 404 returned error can't find the container with id a6a7d239b7b6239539bd2acfc2cdc73995b2c6ac7daca574795c357a7216bafa
Sep 12 02:36:09.418656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.418639    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gm5gm"
Sep 12 02:36:09.421674 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.421653    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5d4bc3_6f21_4729_a523_c19bdd296eaa.slice/crio-72d8db5844e56e7d05f3203eefb94a6cbfcdd398fc4eaaacace9f9004a09eb21 WatchSource:0}: Error finding container 72d8db5844e56e7d05f3203eefb94a6cbfcdd398fc4eaaacace9f9004a09eb21: Status 404 returned error can't find the container with id 72d8db5844e56e7d05f3203eefb94a6cbfcdd398fc4eaaacace9f9004a09eb21
Sep 12 02:36:09.425663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.425644    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l4lzt"
Sep 12 02:36:09.429153 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.429134    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65fb995_c074_4c75_8709_e11ad8ddd764.slice/crio-89e928f305b66fff1b87a48b09b6781231180b0950b1c1fe6f16b628d6ee41dc WatchSource:0}: Error finding container 89e928f305b66fff1b87a48b09b6781231180b0950b1c1fe6f16b628d6ee41dc: Status 404 returned error can't find the container with id 89e928f305b66fff1b87a48b09b6781231180b0950b1c1fe6f16b628d6ee41dc
Sep 12 02:36:09.434016 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.433996    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d9cdbc_b067_4f22_83ae_1917b30f4525.slice/crio-86c1d4b49a9a777bce2d2c0b2a440aec49572fd3b28038fe436e89ea3ed9edf4 WatchSource:0}: Error finding container 86c1d4b49a9a777bce2d2c0b2a440aec49572fd3b28038fe436e89ea3ed9edf4: Status 404 returned error can't find the container with id 86c1d4b49a9a777bce2d2c0b2a440aec49572fd3b28038fe436e89ea3ed9edf4
Sep 12 02:36:09.434638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.434626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:09.439431 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.439402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz"
Sep 12 02:36:09.443585 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.443566    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91392b24_b012_4866_bbae_09944d2051f6.slice/crio-6a9e10c9ceb9eca1b1d338c22c043a0c30993536d5dab30ccff49662c5add2c4 WatchSource:0}: Error finding container 6a9e10c9ceb9eca1b1d338c22c043a0c30993536d5dab30ccff49662c5add2c4: Status 404 returned error can't find the container with id 6a9e10c9ceb9eca1b1d338c22c043a0c30993536d5dab30ccff49662c5add2c4
Sep 12 02:36:09.444259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.444240    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zg9wj"
Sep 12 02:36:09.448340 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.448320    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53f21b4_07f9_4896_b92b_a3e17b586675.slice/crio-9d4e501d7f7b34fbd5b13be20acc38fdb63323943409f3ba6b01dacd38813832 WatchSource:0}: Error finding container 9d4e501d7f7b34fbd5b13be20acc38fdb63323943409f3ba6b01dacd38813832: Status 404 returned error can't find the container with id 9d4e501d7f7b34fbd5b13be20acc38fdb63323943409f3ba6b01dacd38813832
Sep 12 02:36:09.449317 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.449293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:09.453559 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.453533    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f66744_7567_4321_a774_8b0c260e5477.slice/crio-1bb3f9e5e18093d2091e0b50d3e824974cea28e03d96ce89569976f85ebb55e3 WatchSource:0}: Error finding container 1bb3f9e5e18093d2091e0b50d3e824974cea28e03d96ce89569976f85ebb55e3: Status 404 returned error can't find the container with id 1bb3f9e5e18093d2091e0b50d3e824974cea28e03d96ce89569976f85ebb55e3
Sep 12 02:36:09.458131 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:09.458114    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f5028d_d42b_49c2_84fb_0c297c87cee1.slice/crio-8ba84324b53a85199813b11eb543fb369041c4899732d21c0e6ae8daf7e15235 WatchSource:0}: Error finding container 8ba84324b53a85199813b11eb543fb369041c4899732d21c0e6ae8daf7e15235: Status 404 returned error can't find the container with id 8ba84324b53a85199813b11eb543fb369041c4899732d21c0e6ae8daf7e15235
Sep 12 02:36:09.784860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.784778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:09.785024 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.784859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:09.785024 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:09.784893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:09.785024 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.784943    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:09.785024 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.784970    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:09.785024 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.784985    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:09.785316 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.785052    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:36:10.785029733 +0000 UTC m=+3.041010752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:09.785316 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.785078    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:09.785316 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.785094    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:09.785316 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.785132    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:36:10.785114973 +0000 UTC m=+3.041095983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:09.785316 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:09.785166    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:36:10.785143568 +0000 UTC m=+3.041124577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:10.113331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.113150    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-11 02:31:09 +0000 UTC" deadline="2028-04-06 22:25:18.997721964 +0000 UTC"
Sep 12 02:36:10.113331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.113222    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13747h49m8.884505246s"
Sep 12 02:36:10.157851 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.157061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:10.157851 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.157202    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:10.157851 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.157672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:10.157851 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.157777    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:10.197758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.197653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"8ba84324b53a85199813b11eb543fb369041c4899732d21c0e6ae8daf7e15235"}
Sep 12 02:36:10.228386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.228351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zg9wj" event={"ID":"20f66744-7567-4321-a774-8b0c260e5477","Type":"ContainerStarted","Data":"1bb3f9e5e18093d2091e0b50d3e824974cea28e03d96ce89569976f85ebb55e3"}
Sep 12 02:36:10.248079 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.247982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz" event={"ID":"e53f21b4-07f9-4896-b92b-a3e17b586675","Type":"ContainerStarted","Data":"9d4e501d7f7b34fbd5b13be20acc38fdb63323943409f3ba6b01dacd38813832"}
Sep 12 02:36:10.264255 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.264223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kd44x" event={"ID":"91392b24-b012-4866-bbae-09944d2051f6","Type":"ContainerStarted","Data":"6a9e10c9ceb9eca1b1d338c22c043a0c30993536d5dab30ccff49662c5add2c4"}
Sep 12 02:36:10.277005 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.276934    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l4lzt" event={"ID":"d5d9cdbc-b067-4f22-83ae-1917b30f4525","Type":"ContainerStarted","Data":"86c1d4b49a9a777bce2d2c0b2a440aec49572fd3b28038fe436e89ea3ed9edf4"}
Sep 12 02:36:10.286345 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.286294    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gm5gm" event={"ID":"e65fb995-c074-4c75-8709-e11ad8ddd764","Type":"ContainerStarted","Data":"89e928f305b66fff1b87a48b09b6781231180b0950b1c1fe6f16b628d6ee41dc"}
Sep 12 02:36:10.299446 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.299376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jx4ln" event={"ID":"6a5d4bc3-6f21-4729-a523-c19bdd296eaa","Type":"ContainerStarted","Data":"72d8db5844e56e7d05f3203eefb94a6cbfcdd398fc4eaaacace9f9004a09eb21"}
Sep 12 02:36:10.308994 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.308864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerStarted","Data":"a6a7d239b7b6239539bd2acfc2cdc73995b2c6ac7daca574795c357a7216bafa"}
Sep 12 02:36:10.318880 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.318826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-54vpd" event={"ID":"6700e3f9-9a32-41f1-9bcc-4bddf7e31595","Type":"ContainerStarted","Data":"8e73d452af7d11a745f1b9265e30273ed8a60b16799f9077f124929061979056"}
Sep 12 02:36:10.557578 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.557495    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 02:36:10.793669 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.793630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:10.793864 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.793708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:10.793864 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:10.793758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:10.793990 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.793902    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:10.793990 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.793976    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:36:12.793954343 +0000 UTC m=+5.049935342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:10.794683 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.794422    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:10.794683 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.794447    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:10.794683 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.794460    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:10.794683 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.794524    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:36:12.794507982 +0000 UTC m=+5.050488981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:10.794683 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.794593    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:10.794683 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:10.794631    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:36:12.794618404 +0000 UTC m=+5.050599408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:11.016290 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:11.016209    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 12 02:36:11.113801 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:11.113748    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-11 02:31:09 +0000 UTC" deadline="2028-03-28 11:27:56.179632654 +0000 UTC"
Sep 12 02:36:11.113801 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:11.113798    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13520h51m45.065839481s"
Sep 12 02:36:11.155386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:11.155355    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:11.155569 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:11.155520    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:12.155143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:12.154593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:12.155143 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.154730    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:12.155143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:12.155088    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:12.155715 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.155207    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:12.812192 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:12.812107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:12.812192 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:12.812165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:12.812413 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:12.812217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:12.812413 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812365    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:12.812413 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812380    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:12.812413 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812390    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:12.812649 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812434    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:36:16.812420184 +0000 UTC m=+9.068401186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:12.812649 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812528    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:12.812649 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812560    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:36:16.812551283 +0000 UTC m=+9.068532276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:12.812649 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812604    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:12.812649 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:12.812625    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:36:16.812617755 +0000 UTC m=+9.068598750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:13.154615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:13.154496    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:13.154759 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:13.154657    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:14.155740 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:14.154946    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:14.155740 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:14.155127    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:14.155740 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:14.155590    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:14.155740 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:14.155695    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:15.155134 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:15.155101    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:15.155318 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:15.155255    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:16.155156 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:16.155108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:16.155666 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:16.155108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:16.155666 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.155251    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:16.155666 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.155344    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:16.845337 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:16.845300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:16.845541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:16.845380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:16.845541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:16.845420    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:16.845692 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845545    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:16.845692 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845595    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:36:24.845580034 +0000 UTC m=+17.101561030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:16.845833 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845811    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:16.845911 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845829    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:16.845911 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845856    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:16.845911 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845870    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:16.845911 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845897    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:36:24.845876274 +0000 UTC m=+17.101857272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:16.846135 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:16.845922    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:36:24.845905645 +0000 UTC m=+17.101886656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:17.155012 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:17.154760    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:17.155012 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:17.154905    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:18.155977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:18.155567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:18.155977 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:18.155670    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:18.155977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:18.155730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:18.155977 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:18.155852    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:19.154775 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:19.154699    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:19.154945 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:19.154834    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:20.154652 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:20.154616    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:20.155026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:20.154666    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:20.155026 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:20.154750    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:20.155026 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:20.154873    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:21.154903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:21.154870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:21.155244 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:21.154980    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:22.155297 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:22.155261    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:22.155745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:22.155298    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:22.155745 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:22.155395    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:22.155745 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:22.155528    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:23.154652 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:23.154612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:23.154842 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:23.154741    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:24.154686 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:24.154631    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:24.155088 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.154764    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:24.155088 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:24.154819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:24.155088 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.154916    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:24.906645 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:24.906555    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:24.906645 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:24.906619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:24.906649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906723    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906748    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906751    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906761    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906775    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906811    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:36:40.906792461 +0000 UTC m=+33.162773469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906829    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:36:40.906818977 +0000 UTC m=+33.162799976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:24.906861 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:24.906844    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:36:40.906835524 +0000 UTC m=+33.162816521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:25.155454 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:25.155421    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:25.155878 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:25.155535    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:26.155292 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:26.155262    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:26.155551 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:26.155391    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:26.155551 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:26.155436    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:26.155960 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:26.155553    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:27.154500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:27.154464    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:27.154671 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:27.154581    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:28.155871 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:28.155817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:28.156464 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:28.155923    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:28.156464 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:28.156247    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:28.156464 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:28.156342    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:29.155478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.155116    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:29.155939 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:29.155627    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:29.371215 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.370995    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:36:29.371721 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.371692    2583 generic.go:356] "Generic (PLEG): container finished" podID="35f5028d-d42b-49c2-84fb-0c297c87cee1" containerID="a2a1d7d8020621910cbfee0473cfb41ca1d7e489242a1ed4b1402d2265b2277d" exitCode=1
Sep 12 02:36:29.371817 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.371772    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"c167ae2fd9df52817eeb5dbc83cf3c8819c110fa7642431946d8f161d64d8557"}
Sep 12 02:36:29.371932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.371910    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"7549f78dfe8abf134000bed201ffbb578fb61a902e97057323ed8207adec24fb"}
Sep 12 02:36:29.371995 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.371974    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"c37b4250b041094e4a2a936e11b04c9de08440cf35d4fe3b57f5bb8fa4284eee"}
Sep 12 02:36:29.372057 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.372023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerDied","Data":"a2a1d7d8020621910cbfee0473cfb41ca1d7e489242a1ed4b1402d2265b2277d"}
Sep 12 02:36:29.372115 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.372073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"dd8abb1bd6b891b26d1c78e9b0df89f0c373374338948f2b3602d2acf5893792"}
Sep 12 02:36:29.373573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.373548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l4lzt" event={"ID":"d5d9cdbc-b067-4f22-83ae-1917b30f4525","Type":"ContainerStarted","Data":"d7e72d971b59aaf9dafd87bb1021911722697ad37604fd07f1662619ddc9a37f"}
Sep 12 02:36:29.376687 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.376449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jx4ln" event={"ID":"6a5d4bc3-6f21-4729-a523-c19bdd296eaa","Type":"ContainerStarted","Data":"6d9e1325ca78c332a23df021930174d85a9bd2a94cef0a6fd24e59f16d9cc51d"}
Sep 12 02:36:29.381314 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.380330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" event={"ID":"63281233adfc708d92a6c41e2612bf0d","Type":"ContainerStarted","Data":"b0824b0b075ea3d6288c9e8f72aa37dda57decedf41d73cb45ebe8b0961b655f"}
Sep 12 02:36:29.390699 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.390162    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l4lzt" podStartSLOduration=2.023260014 podStartE2EDuration="21.390145154s" totalImagesPullingTime="19.36688514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:29.388800656 +0000 UTC m=+21.644781674" watchObservedRunningTime="2026-09-12 02:36:29.390145154 +0000 UTC m=+21.646126169"
Sep 12 02:36:29.402868 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:29.401838    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-22.ec2.internal" podStartSLOduration=20.401819439 podStartE2EDuration="20.401819439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:29.40114276 +0000 UTC m=+21.657123775" watchObservedRunningTime="2026-09-12 02:36:29.401819439 +0000 UTC m=+21.657800454"
Sep 12 02:36:30.154837 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.154808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:30.154935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.154814    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:30.154935 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:30.154913    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:30.155031 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:30.154971    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:30.249305 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.249282    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 12 02:36:30.384144 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.384061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kd44x" event={"ID":"91392b24-b012-4866-bbae-09944d2051f6","Type":"ContainerStarted","Data":"ef544135a15dbd94517afc78e669ae34ed46e71b865de283186d3a06ed87b6c4"}
Sep 12 02:36:30.385539 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.385512    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gm5gm" event={"ID":"e65fb995-c074-4c75-8709-e11ad8ddd764","Type":"ContainerStarted","Data":"a54d78e81a2e36ba0527755afff1e70186e3162537072fd896efced781796111"}
Sep 12 02:36:30.387085 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.387063    2583 generic.go:356] "Generic (PLEG): container finished" podID="01fa6190-8c9c-47de-b592-3c42d9219593" containerID="1829b28d36a4ab9762bea906becceaae78d2ba218dee7e86b7de1c96ffd74351" exitCode=0
Sep 12 02:36:30.387176 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.387142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerDied","Data":"1829b28d36a4ab9762bea906becceaae78d2ba218dee7e86b7de1c96ffd74351"}
Sep 12 02:36:30.388757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.388738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-54vpd" event={"ID":"6700e3f9-9a32-41f1-9bcc-4bddf7e31595","Type":"ContainerStarted","Data":"1cd21fb545ea031b5f852dd97bbc97551cf3c410d33a8942b5a7ede3b9d675ea"}
Sep 12 02:36:30.392783 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.392760    2583 generic.go:356] "Generic (PLEG): container finished" podID="b5b0e3f2dc83ed2abd172e86e7c42146" containerID="ce18307a6dfb32d559c25030f5f98e94b052f678e9c67adee05c92445e01a319" exitCode=0
Sep 12 02:36:30.392873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.392842    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" event={"ID":"b5b0e3f2dc83ed2abd172e86e7c42146","Type":"ContainerDied","Data":"ce18307a6dfb32d559c25030f5f98e94b052f678e9c67adee05c92445e01a319"}
Sep 12 02:36:30.397633 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.397582    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kd44x" podStartSLOduration=3.106951087 podStartE2EDuration="22.397568546s" totalImagesPullingTime="19.290617459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:30.397130314 +0000 UTC m=+22.653111329" watchObservedRunningTime="2026-09-12 02:36:30.397568546 +0000 UTC m=+22.653549560"
Sep 12 02:36:30.397739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.397694    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jx4ln" podStartSLOduration=3.055092821 podStartE2EDuration="22.397687709s" totalImagesPullingTime="19.342594888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:29.416101593 +0000 UTC m=+21.672082609" watchObservedRunningTime="2026-09-12 02:36:30.397687709 +0000 UTC m=+22.653668724"
Sep 12 02:36:30.398118 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.398104    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:36:30.398445 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.398427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"4e2bb9dbd5e52d67c6dd9fc43e2e67577e84c4a2d6e4988b8e55c708a9f616d2"}
Sep 12 02:36:30.399717 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.399701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zg9wj" event={"ID":"20f66744-7567-4321-a774-8b0c260e5477","Type":"ContainerStarted","Data":"e781d99e60316c5788c42db8b6bb9226eaef56adaa0e2949a470600d2451fc32"}
Sep 12 02:36:30.401335 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.401307    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz" event={"ID":"e53f21b4-07f9-4896-b92b-a3e17b586675","Type":"ContainerStarted","Data":"a0c584ab31abc3e4982dbd5601f909c1f096d3b5b118150fd29d2684436789ad"}
Sep 12 02:36:30.401437 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.401358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz" event={"ID":"e53f21b4-07f9-4896-b92b-a3e17b586675","Type":"ContainerStarted","Data":"581e4dfc6e8f39778ab9b169ee5b95f6c10fb83bfd697eb2d1dee96b27d649da"}
Sep 12 02:36:30.410052 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.410020    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gm5gm" podStartSLOduration=3.105513285 podStartE2EDuration="22.410009298s" totalImagesPullingTime="19.304496013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:30.409588703 +0000 UTC m=+22.665569723" watchObservedRunningTime="2026-09-12 02:36:30.410009298 +0000 UTC m=+22.665990312"
Sep 12 02:36:30.433991 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.433953    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-54vpd" podStartSLOduration=3.080092711 podStartE2EDuration="22.433939949s" totalImagesPullingTime="19.353847238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:30.433822119 +0000 UTC m=+22.689803135" watchObservedRunningTime="2026-09-12 02:36:30.433939949 +0000 UTC m=+22.689920965"
Sep 12 02:36:30.465004 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:30.464969    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zg9wj" podStartSLOduration=3.184870918 podStartE2EDuration="22.464957351s" totalImagesPullingTime="19.280086433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:30.464663897 +0000 UTC m=+22.720644913" watchObservedRunningTime="2026-09-12 02:36:30.464957351 +0000 UTC m=+22.720938366"
Sep 12 02:36:31.138117 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.137878    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-12T02:36:30.249301706Z","UUID":"7f410a51-176f-497c-9bac-e1d770b8d5a0","Handler":null,"Name":"","Endpoint":""}
Sep 12 02:36:31.139176 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.139156    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 12 02:36:31.139287 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.139184    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 12 02:36:31.154633 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.154614    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:31.154729 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:31.154702    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:31.405898 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.405865    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz" event={"ID":"e53f21b4-07f9-4896-b92b-a3e17b586675","Type":"ContainerStarted","Data":"f30a82b6c7610212289a509e1a6ef6cbc0b2372c299233bee72a4253674b9ee0"}
Sep 12 02:36:31.408074 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.408020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" event={"ID":"b5b0e3f2dc83ed2abd172e86e7c42146","Type":"ContainerStarted","Data":"262086aebd8fb3c25bd3008af118eeac3843cc6a63412e77eb2c2c8d61ffd753"}
Sep 12 02:36:31.433780 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.433737    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kx9xz" podStartSLOduration=2.61050608 podStartE2EDuration="23.433718663s" totalImagesPullingTime="20.823212583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:31.420929031 +0000 UTC m=+23.676910048" watchObservedRunningTime="2026-09-12 02:36:31.433718663 +0000 UTC m=+23.689699679"
Sep 12 02:36:31.433907 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:31.433853    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-22.ec2.internal" podStartSLOduration=22.433848672 podStartE2EDuration="22.433848672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:31.433306983 +0000 UTC m=+23.689288000" watchObservedRunningTime="2026-09-12 02:36:31.433848672 +0000 UTC m=+23.689829686"
Sep 12 02:36:32.154613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:32.154577    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:32.154865 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:32.154703    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:32.154865 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:32.154760    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:32.154865 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:32.154859    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:32.412671 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:32.412601    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:36:32.413063 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:32.412991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"bc5c91e9753cf911b6c912642eb7ec599e4bd9fa52fbfeb0963068cd283a0b66"}
Sep 12 02:36:32.992804 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:32.992776    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:32.993528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:32.993500    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:33.154699 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:33.154671    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:33.154829 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:33.154772    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:33.414856 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:33.414829    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:33.415231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:33.415215    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kd44x"
Sep 12 02:36:34.154518 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.154484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:34.154518 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.154527    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:34.154895 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:34.154641    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:34.154895 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:34.154756    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:34.421784 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.421712    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:36:34.422210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.422159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"ea3e9feb75bb8a31ede0f620a80b211dcb5f34b3ab77482367809ccac9fc7d78"}
Sep 12 02:36:34.422578 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.422554    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:34.422709 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.422633    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:34.422766 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.422743    2583 scope.go:117] "RemoveContainer" containerID="a2a1d7d8020621910cbfee0473cfb41ca1d7e489242a1ed4b1402d2265b2277d"
Sep 12 02:36:34.438894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:34.438715    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:35.155000 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.154972    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:35.155137 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:35.155096    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:35.539017 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.538560    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jbch"]
Sep 12 02:36:35.539017 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.538742    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:35.539017 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:35.538855    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:35.539662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.539350    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vt47l"]
Sep 12 02:36:35.539662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.539480    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:35.539662 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:35.539578    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:35.539998 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.539972    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrrtt"]
Sep 12 02:36:35.540121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:35.540071    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:35.540186 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:35.540159    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:36.429847 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.429819    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:36:36.430244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.430220    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" event={"ID":"35f5028d-d42b-49c2-84fb-0c297c87cee1","Type":"ContainerStarted","Data":"a8141c7ab8e335ab3450f98c78773d7cf77245c8f635d03a6e5cc8a995746e58"}
Sep 12 02:36:36.430522 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.430501    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:36.432090 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.432066    2583 generic.go:356] "Generic (PLEG): container finished" podID="01fa6190-8c9c-47de-b592-3c42d9219593" containerID="cb7a25acb352a3e158d97413eddd37ee2a2d5fbc16a89b8b9785fb4fcde43312" exitCode=0
Sep 12 02:36:36.432181 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.432105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerDied","Data":"cb7a25acb352a3e158d97413eddd37ee2a2d5fbc16a89b8b9785fb4fcde43312"}
Sep 12 02:36:36.444928 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.444907    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:36:36.456482 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:36.456442    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" podStartSLOduration=8.956546027 podStartE2EDuration="28.456429199s" totalImagesPullingTime="19.499883172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:36.454963441 +0000 UTC m=+28.710944467" watchObservedRunningTime="2026-09-12 02:36:36.456429199 +0000 UTC m=+28.712410216"
Sep 12 02:36:37.155014 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:37.154977    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:37.155658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:37.155025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:37.155658 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:37.155102    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:37.155658 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:37.155150    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:37.155658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:37.155171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:37.155658 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:37.155241    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:38.439259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:38.439089    2583 generic.go:356] "Generic (PLEG): container finished" podID="01fa6190-8c9c-47de-b592-3c42d9219593" containerID="a022b5d003a2eee4753aeb969d32de766da8f09f3480d42e8ba8ef37cf92c48e" exitCode=0
Sep 12 02:36:38.439699 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:38.439177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerDied","Data":"a022b5d003a2eee4753aeb969d32de766da8f09f3480d42e8ba8ef37cf92c48e"}
Sep 12 02:36:38.453716 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:38.453681    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45" podUID="35f5028d-d42b-49c2-84fb-0c297c87cee1" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 12 02:36:39.155027 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:39.155005    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:39.155159 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:39.155099    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:39.155159 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:39.155105    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:39.155159 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:39.155146    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:39.155319 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:39.155245    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:39.155369 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:39.155330    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:39.443837 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:39.443764    2583 generic.go:356] "Generic (PLEG): container finished" podID="01fa6190-8c9c-47de-b592-3c42d9219593" containerID="be178dfbb23bc25cd810f57aab4878ca65042375e653a3f263519b5a85124c0e" exitCode=0
Sep 12 02:36:39.443837 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:39.443812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerDied","Data":"be178dfbb23bc25cd810f57aab4878ca65042375e653a3f263519b5a85124c0e"}
Sep 12 02:36:40.927114 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:40.927075    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:40.927128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:40.927151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927233    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927248    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927269    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927278    2583 projected.go:196] Error preparing data for projected volume kube-api-access-mk9rg for pod openshift-network-diagnostics/network-check-target-5jbch: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927286    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret podName:07438c10-c798-4c41-adbc-7cb89858375e nodeName:}" failed. No retries permitted until 2026-09-12 02:37:12.927273207 +0000 UTC m=+65.183254203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret") pod "global-pull-secret-syncer-lrrtt" (UID: "07438c10-c798-4c41-adbc-7cb89858375e") : object "kube-system"/"original-pull-secret" not registered
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927238    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927319    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg podName:07baf5ab-df7e-4838-a1f9-bd94e07e33ea nodeName:}" failed. No retries permitted until 2026-09-12 02:37:12.92730334 +0000 UTC m=+65.183284354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mk9rg" (UniqueName: "kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg") pod "network-check-target-5jbch" (UID: "07baf5ab-df7e-4838-a1f9-bd94e07e33ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 12 02:36:40.927547 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:40.927391    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:37:12.927372002 +0000 UTC m=+65.183352998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 12 02:36:41.154440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:41.154393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:41.154604 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:41.154398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:41.154604 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:41.154549    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:36:41.154718 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:41.154398    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:41.154718 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:41.154644    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrrtt" podUID="07438c10-c798-4c41-adbc-7cb89858375e"
Sep 12 02:36:41.154718 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:41.154701    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5jbch" podUID="07baf5ab-df7e-4838-a1f9-bd94e07e33ea"
Sep 12 02:36:41.988997 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:41.988969    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-22.ec2.internal" event="NodeReady"
Sep 12 02:36:41.989341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:41.989075    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 12 02:36:42.028495 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.028461    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dxc6w"]
Sep 12 02:36:42.032064 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.032037    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xwmwg"]
Sep 12 02:36:42.032193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.032171    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.034704 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.034681    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4279k\""
Sep 12 02:36:42.034826 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.034805    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 12 02:36:42.035269 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.035243    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 12 02:36:42.036073 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.036055    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.038422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.038287    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 12 02:36:42.039762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.038664    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 12 02:36:42.039762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.038801    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 12 02:36:42.039762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.038904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-96kxp\""
Sep 12 02:36:42.039762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.039753    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxc6w"]
Sep 12 02:36:42.043096 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.043075    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xwmwg"]
Sep 12 02:36:42.136700 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.136664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.136852 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.136715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bscrt\" (UniqueName: \"kubernetes.io/projected/6d05a217-bc5c-4057-bf32-595614a6310c-kube-api-access-bscrt\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.136852 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.136762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d05a217-bc5c-4057-bf32-595614a6310c-tmp-dir\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.136852 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.136799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd7accf5-b2b2-4bc6-826e-25cd48d6444d-cert\") pod \"ingress-canary-xwmwg\" (UID: \"fd7accf5-b2b2-4bc6-826e-25cd48d6444d\") " pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.136985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.136867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d05a217-bc5c-4057-bf32-595614a6310c-config-volume\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.136985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.136894    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmgsd\" (UniqueName: \"kubernetes.io/projected/fd7accf5-b2b2-4bc6-826e-25cd48d6444d-kube-api-access-qmgsd\") pod \"ingress-canary-xwmwg\" (UID: \"fd7accf5-b2b2-4bc6-826e-25cd48d6444d\") " pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.237494 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.237676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237510    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bscrt\" (UniqueName: \"kubernetes.io/projected/6d05a217-bc5c-4057-bf32-595614a6310c-kube-api-access-bscrt\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.237676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d05a217-bc5c-4057-bf32-595614a6310c-tmp-dir\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.237676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd7accf5-b2b2-4bc6-826e-25cd48d6444d-cert\") pod \"ingress-canary-xwmwg\" (UID: \"fd7accf5-b2b2-4bc6-826e-25cd48d6444d\") " pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.237676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d05a217-bc5c-4057-bf32-595614a6310c-config-volume\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.237676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmgsd\" (UniqueName: \"kubernetes.io/projected/fd7accf5-b2b2-4bc6-826e-25cd48d6444d-kube-api-access-qmgsd\") pod \"ingress-canary-xwmwg\" (UID: \"fd7accf5-b2b2-4bc6-826e-25cd48d6444d\") " pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.237676 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:42.237651    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:36:42.238010 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:42.237716    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:36:42.737697484 +0000 UTC m=+34.993678492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:36:42.238010 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.237995    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d05a217-bc5c-4057-bf32-595614a6310c-tmp-dir\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.238166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.238150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d05a217-bc5c-4057-bf32-595614a6310c-config-volume\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.241719 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.241679    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd7accf5-b2b2-4bc6-826e-25cd48d6444d-cert\") pod \"ingress-canary-xwmwg\" (UID: \"fd7accf5-b2b2-4bc6-826e-25cd48d6444d\") " pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.245992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.245964    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bscrt\" (UniqueName: \"kubernetes.io/projected/6d05a217-bc5c-4057-bf32-595614a6310c-kube-api-access-bscrt\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.245992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.245984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmgsd\" (UniqueName: \"kubernetes.io/projected/fd7accf5-b2b2-4bc6-826e-25cd48d6444d-kube-api-access-qmgsd\") pod \"ingress-canary-xwmwg\" (UID: \"fd7accf5-b2b2-4bc6-826e-25cd48d6444d\") " pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.352486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.352460    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xwmwg"
Sep 12 02:36:42.637003 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.636969    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xwmwg"]
Sep 12 02:36:42.741716 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:42.741538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:42.741716 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:42.741718    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:36:42.741951 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:42.741785    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:36:43.74176789 +0000 UTC m=+35.997748883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:36:43.155331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.155278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:36:43.155331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.155321    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:36:43.155948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.155524    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:36:43.159037 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.158992    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 12 02:36:43.159193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.159177    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 12 02:36:43.159277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.159190    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k9jkq\""
Sep 12 02:36:43.159277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.159208    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 12 02:36:43.159277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.159176    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mt5x\""
Sep 12 02:36:43.159449 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.159316    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 12 02:36:43.750593 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:43.750554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:43.750778 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:43.750720    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:36:43.750844 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:43.750796    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:36:45.750773691 +0000 UTC m=+38.006754685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:36:43.979239 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:36:43.979208    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7accf5_b2b2_4bc6_826e_25cd48d6444d.slice/crio-a463a78706431dbbd948501b7202284804efb9dbdf5d4dc60bb1b05c1288422e WatchSource:0}: Error finding container a463a78706431dbbd948501b7202284804efb9dbdf5d4dc60bb1b05c1288422e: Status 404 returned error can't find the container with id a463a78706431dbbd948501b7202284804efb9dbdf5d4dc60bb1b05c1288422e
Sep 12 02:36:44.459317 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:44.459286    2583 generic.go:356] "Generic (PLEG): container finished" podID="01fa6190-8c9c-47de-b592-3c42d9219593" containerID="4d5a07bd72e4e9ee1e7f40b6f96506d4d86b2f33cfc1c89abb6ccfcb82ecc6ad" exitCode=0
Sep 12 02:36:44.459828 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:44.459356    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerDied","Data":"4d5a07bd72e4e9ee1e7f40b6f96506d4d86b2f33cfc1c89abb6ccfcb82ecc6ad"}
Sep 12 02:36:44.460566 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:44.460544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xwmwg" event={"ID":"fd7accf5-b2b2-4bc6-826e-25cd48d6444d","Type":"ContainerStarted","Data":"a463a78706431dbbd948501b7202284804efb9dbdf5d4dc60bb1b05c1288422e"}
Sep 12 02:36:45.466991 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:45.466915    2583 generic.go:356] "Generic (PLEG): container finished" podID="01fa6190-8c9c-47de-b592-3c42d9219593" containerID="5a90899a4e2a68f7ca71aeb7eea1e88c811d5fcd2f1a1ea7a91875cc9d7abb3c" exitCode=0
Sep 12 02:36:45.466991 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:45.466961    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerDied","Data":"5a90899a4e2a68f7ca71aeb7eea1e88c811d5fcd2f1a1ea7a91875cc9d7abb3c"}
Sep 12 02:36:45.764985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:45.764911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:45.765121 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:45.765097    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:36:45.765196 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:45.765179    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:36:49.765155492 +0000 UTC m=+42.021136489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:36:46.472436 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:46.472376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-49mpg" event={"ID":"01fa6190-8c9c-47de-b592-3c42d9219593","Type":"ContainerStarted","Data":"d27ee568d85858210adb6f3ab9cbb478384791953966903ab73edfdca13b61ca"}
Sep 12 02:36:46.492702 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:46.492659    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-49mpg" podStartSLOduration=7.473357452 podStartE2EDuration="38.492645231s" totalImagesPullingTime="31.019287779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:46.491292806 +0000 UTC m=+38.747273820" watchObservedRunningTime="2026-09-12 02:36:46.492645231 +0000 UTC m=+38.748626243"
Sep 12 02:36:47.476048 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:47.476009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xwmwg" event={"ID":"fd7accf5-b2b2-4bc6-826e-25cd48d6444d","Type":"ContainerStarted","Data":"c51da3b54814b430e913b1d806a5da50d182375bab4fe0b18486646d7b324363"}
Sep 12 02:36:47.491043 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:47.491000    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xwmwg" podStartSLOduration=2.711416411 podStartE2EDuration="5.490986326s" totalImagesPullingTime="2.779569915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:36:47.490610536 +0000 UTC m=+39.746591552" watchObservedRunningTime="2026-09-12 02:36:47.490986326 +0000 UTC m=+39.746967340"
Sep 12 02:36:49.788774 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:49.788745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:49.789128 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:49.788885    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:36:49.789128 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:49.788945    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:36:57.78892857 +0000 UTC m=+50.044909563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:36:57.846349 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:36:57.846305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:36:57.846965 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:57.846508    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:36:57.846965 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:36:57.846621    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:37:13.846586118 +0000 UTC m=+66.102567129 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:37:08.448621 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:08.448594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9lx45"
Sep 12 02:37:12.954009 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.953958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:37:12.954476 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.954020    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:37:12.954476 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.954177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:37:12.956658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.956640    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 12 02:37:12.956800 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.956779    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 12 02:37:12.956839 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.956782    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 12 02:37:12.964736 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:37:12.964718    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 02:37:12.964800 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:37:12.964788    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:38:16.964765525 +0000 UTC m=+129.220746526 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : secret "metrics-daemon-secret" not found
Sep 12 02:37:12.966563 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.966539    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 12 02:37:12.967786 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.967770    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07438c10-c798-4c41-adbc-7cb89858375e-original-pull-secret\") pod \"global-pull-secret-syncer-lrrtt\" (UID: \"07438c10-c798-4c41-adbc-7cb89858375e\") " pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:37:12.977654 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:12.977627    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9rg\" (UniqueName: \"kubernetes.io/projected/07baf5ab-df7e-4838-a1f9-bd94e07e33ea-kube-api-access-mk9rg\") pod \"network-check-target-5jbch\" (UID: \"07baf5ab-df7e-4838-a1f9-bd94e07e33ea\") " pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:37:13.178163 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.178129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7mt5x\""
Sep 12 02:37:13.179990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.179971    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrrtt"
Sep 12 02:37:13.185812 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.185791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:37:13.457594 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.457560    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrrtt"]
Sep 12 02:37:13.460882 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:37:13.460853    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07438c10_c798_4c41_adbc_7cb89858375e.slice/crio-850ebd982bf8e6cc65e07e1ce9e5726fd7fa3509b6ae840f0a665bf3faea3fab WatchSource:0}: Error finding container 850ebd982bf8e6cc65e07e1ce9e5726fd7fa3509b6ae840f0a665bf3faea3fab: Status 404 returned error can't find the container with id 850ebd982bf8e6cc65e07e1ce9e5726fd7fa3509b6ae840f0a665bf3faea3fab
Sep 12 02:37:13.465205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.465184    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5jbch"]
Sep 12 02:37:13.468305 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:37:13.468281    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07baf5ab_df7e_4838_a1f9_bd94e07e33ea.slice/crio-dbf1018fedea78b4ec7593bd4664e097ceef8912146177e1d8d226d86019e57b WatchSource:0}: Error finding container dbf1018fedea78b4ec7593bd4664e097ceef8912146177e1d8d226d86019e57b: Status 404 returned error can't find the container with id dbf1018fedea78b4ec7593bd4664e097ceef8912146177e1d8d226d86019e57b
Sep 12 02:37:13.536137 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.536046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jbch" event={"ID":"07baf5ab-df7e-4838-a1f9-bd94e07e33ea","Type":"ContainerStarted","Data":"dbf1018fedea78b4ec7593bd4664e097ceef8912146177e1d8d226d86019e57b"}
Sep 12 02:37:13.537293 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.537269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrrtt" event={"ID":"07438c10-c798-4c41-adbc-7cb89858375e","Type":"ContainerStarted","Data":"850ebd982bf8e6cc65e07e1ce9e5726fd7fa3509b6ae840f0a665bf3faea3fab"}
Sep 12 02:37:13.860377 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:13.860344    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:37:13.860564 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:37:13.860512    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:37:13.860611 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:37:13.860577    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:37:45.860559212 +0000 UTC m=+98.116540206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:37:18.553595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:18.553553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5jbch" event={"ID":"07baf5ab-df7e-4838-a1f9-bd94e07e33ea","Type":"ContainerStarted","Data":"05b5917005fdbd4a6b4c56f326480be38cd1e69b71ecada4d47a31ea1760d698"}
Sep 12 02:37:18.554153 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:18.553651    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:37:18.555077 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:18.555046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrrtt" event={"ID":"07438c10-c798-4c41-adbc-7cb89858375e","Type":"ContainerStarted","Data":"6c18af014c0a34aff6914024da010e46e62d313b78c6e2be12b010b9cd130d88"}
Sep 12 02:37:18.567204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:18.567156    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5jbch" podStartSLOduration=66.144347454 podStartE2EDuration="1m10.567141032s" totalImagesPullingTime="4.422793578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:37:18.566663323 +0000 UTC m=+70.822644337" watchObservedRunningTime="2026-09-12 02:37:18.567141032 +0000 UTC m=+70.823122046"
Sep 12 02:37:18.580134 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:18.580086    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lrrtt" podStartSLOduration=66.146678891 podStartE2EDuration="1m10.580070089s" totalImagesPullingTime="4.433391198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:37:18.579350771 +0000 UTC m=+70.835331787" watchObservedRunningTime="2026-09-12 02:37:18.580070089 +0000 UTC m=+70.836051104"
Sep 12 02:37:24.443853 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.443826    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"]
Sep 12 02:37:24.448971 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.448953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.451194 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.451171    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 12 02:37:24.451290 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.451174    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 12 02:37:24.452380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.452360    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 12 02:37:24.452478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.452398    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7zcn2\""
Sep 12 02:37:24.452478 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.452397    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 12 02:37:24.453906 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.453882    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"]
Sep 12 02:37:24.535318 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.535297    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqt2l\" (UniqueName: \"kubernetes.io/projected/636366bc-032d-4980-8528-d23df84484ba-kube-api-access-gqt2l\") pod \"managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6\" (UID: \"636366bc-032d-4980-8528-d23df84484ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.535439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.535334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/636366bc-032d-4980-8528-d23df84484ba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6\" (UID: \"636366bc-032d-4980-8528-d23df84484ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.636310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.636284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/636366bc-032d-4980-8528-d23df84484ba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6\" (UID: \"636366bc-032d-4980-8528-d23df84484ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.636423 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.636342    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqt2l\" (UniqueName: \"kubernetes.io/projected/636366bc-032d-4980-8528-d23df84484ba-kube-api-access-gqt2l\") pod \"managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6\" (UID: \"636366bc-032d-4980-8528-d23df84484ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.638605 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.638584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/636366bc-032d-4980-8528-d23df84484ba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6\" (UID: \"636366bc-032d-4980-8528-d23df84484ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.643702 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.643676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqt2l\" (UniqueName: \"kubernetes.io/projected/636366bc-032d-4980-8528-d23df84484ba-kube-api-access-gqt2l\") pod \"managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6\" (UID: \"636366bc-032d-4980-8528-d23df84484ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:24.775516 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:24.775421    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"
Sep 12 02:37:25.038616 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:25.038545    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6"]
Sep 12 02:37:25.041884 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:37:25.041857    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod636366bc_032d_4980_8528_d23df84484ba.slice/crio-cdd1bbb739285d77321c6c714b6a5cd44a41e2d56289b059b7101ca06ccb7f99 WatchSource:0}: Error finding container cdd1bbb739285d77321c6c714b6a5cd44a41e2d56289b059b7101ca06ccb7f99: Status 404 returned error can't find the container with id cdd1bbb739285d77321c6c714b6a5cd44a41e2d56289b059b7101ca06ccb7f99
Sep 12 02:37:25.573803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:25.573767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6" event={"ID":"636366bc-032d-4980-8528-d23df84484ba","Type":"ContainerStarted","Data":"cdd1bbb739285d77321c6c714b6a5cd44a41e2d56289b059b7101ca06ccb7f99"}
Sep 12 02:37:27.580376 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:27.580347    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6" event={"ID":"636366bc-032d-4980-8528-d23df84484ba","Type":"ContainerStarted","Data":"54a679700b4d7d1a8b7bf8ce5cbd867eefe9deae82019e66aed895369107a823"}
Sep 12 02:37:27.597690 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:27.597650    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6" podStartSLOduration=1.152354026 podStartE2EDuration="3.597634027s" totalImagesPullingTime="2.445280001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:37:27.597517204 +0000 UTC m=+79.853498219" watchObservedRunningTime="2026-09-12 02:37:27.597634027 +0000 UTC m=+79.853615043"
Sep 12 02:37:45.875918 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:45.875867    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:37:45.876296 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:37:45.876025    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:37:45.876296 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:37:45.876109    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:38:49.876087542 +0000 UTC m=+162.132068537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:37:49.560655 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:37:49.560620    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5jbch"
Sep 12 02:38:16.971592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:38:16.971551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:38:16.972046 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:38:16.971665    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 02:38:16.972046 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:38:16.971725    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:40:18.971708956 +0000 UTC m=+251.227689963 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : secret "metrics-daemon-secret" not found
Sep 12 02:38:45.046581 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:38:45.046523    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dxc6w" podUID="6d05a217-bc5c-4057-bf32-595614a6310c"
Sep 12 02:38:45.762706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:38:45.762677    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:38:46.168512 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:38:46.168472    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:38:49.885771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:38:49.885718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:38:49.886173 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:38:49.885867    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 12 02:38:49.886173 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:38:49.885932    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls podName:6d05a217-bc5c-4057-bf32-595614a6310c nodeName:}" failed. No retries permitted until 2026-09-12 02:40:51.885917645 +0000 UTC m=+284.141898637 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls") pod "dns-default-dxc6w" (UID: "6d05a217-bc5c-4057-bf32-595614a6310c") : secret "dns-default-metrics-tls" not found
Sep 12 02:39:01.154683 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:39:01.154602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:39:27.868193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:39:27.868110    2583 generic.go:356] "Generic (PLEG): container finished" podID="636366bc-032d-4980-8528-d23df84484ba" containerID="54a679700b4d7d1a8b7bf8ce5cbd867eefe9deae82019e66aed895369107a823" exitCode=255
Sep 12 02:39:27.868193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:39:27.868156    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6" event={"ID":"636366bc-032d-4980-8528-d23df84484ba","Type":"ContainerDied","Data":"54a679700b4d7d1a8b7bf8ce5cbd867eefe9deae82019e66aed895369107a823"}
Sep 12 02:39:27.873714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:39:27.873697    2583 scope.go:117] "RemoveContainer" containerID="54a679700b4d7d1a8b7bf8ce5cbd867eefe9deae82019e66aed895369107a823"
Sep 12 02:39:28.874566 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:39:28.874527    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cf84bb6d4-4xqp6" event={"ID":"636366bc-032d-4980-8528-d23df84484ba","Type":"ContainerStarted","Data":"3d7cd573c2f32a532a026c69d950acfa4ea92f956a1bd8ad6ed94a7c197f03a2"}
Sep 12 02:40:03.450997 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.450963    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bfc648fc5-xmhrr"]
Sep 12 02:40:03.453771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.453751    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.456415 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.456373    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 12 02:40:03.456415 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.456388    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtp6k\""
Sep 12 02:40:03.456573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.456374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 12 02:40:03.456573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.456526    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 12 02:40:03.461233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.461216    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 12 02:40:03.468355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.468337    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bfc648fc5-xmhrr"]
Sep 12 02:40:03.544860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.544838    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"]
Sep 12 02:40:03.547642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.547626    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.549467 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.549422    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"]
Sep 12 02:40:03.550603 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.550584    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 12 02:40:03.550706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.550621    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 12 02:40:03.550706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.550584    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 12 02:40:03.550832 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.550817    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 12 02:40:03.551078 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.551063    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6vz55\""
Sep 12 02:40:03.552371 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.552354    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-r444n"]
Sep 12 02:40:03.552483 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.552456    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:03.555033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.555014    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f78d98684-sxr7z"]
Sep 12 02:40:03.555136 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.555070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.555136 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.555016    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 12 02:40:03.555625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.555506    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 12 02:40:03.555625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.555524    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 12 02:40:03.555625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.555574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d27rp\""
Sep 12 02:40:03.556435 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556418    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-certificates\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-trusted-ca\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-bound-sa-token\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556589 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-image-registry-private-configuration\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556589 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5761086-b3f2-4b2e-92c9-26462fdd9c31-ca-trust-extracted\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556654 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cvph\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-kube-api-access-9cvph\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556654 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.556654 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.556635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-installation-pull-secrets\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.557358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.557342    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5bpbr\""
Sep 12 02:40:03.557446 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.557343    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 12 02:40:03.557830 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.557810    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.558056 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.557944    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 12 02:40:03.558126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.558112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 12 02:40:03.558682 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.558668    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 12 02:40:03.560858 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.560840    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b8rwm\""
Sep 12 02:40:03.560858 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.560849    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 12 02:40:03.561010 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.560881    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 12 02:40:03.561010 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.560853    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 12 02:40:03.561272 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.561255    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 12 02:40:03.561332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.561284    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 12 02:40:03.561382 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.561285    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 12 02:40:03.564530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.564510    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 12 02:40:03.564802 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.564784    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"]
Sep 12 02:40:03.565541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.565522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"]
Sep 12 02:40:03.566237 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.566220    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-r444n"]
Sep 12 02:40:03.568716 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.567713    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f78d98684-sxr7z"]
Sep 12 02:40:03.657118 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cvph\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-kube-api-access-9cvph\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.657251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:03.657251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75c9e2fc-13ee-45c0-824e-396644cb5fff-serving-cert\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.657251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-trusted-ca\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.657251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c9e2fc-13ee-45c0-824e-396644cb5fff-config\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-installation-pull-secrets\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-stats-auth\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th8nw\" (UniqueName: \"kubernetes.io/projected/9307961d-04e4-4d29-8282-7a8099702591-kube-api-access-th8nw\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-certificates\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.657464    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.657475    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfc648fc5-xmhrr: secret "image-registry-tls" not found
Sep 12 02:40:03.657523 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.657526    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls podName:e5761086-b3f2-4b2e-92c9-26462fdd9c31 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:04.157513126 +0000 UTC m=+236.413494119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls") pod "image-registry-6bfc648fc5-xmhrr" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31") : secret "image-registry-tls" not found
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r69g\" (UniqueName: \"kubernetes.io/projected/dbcbff98-95b5-43d6-9967-d84e15a7dea0-kube-api-access-2r69g\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjt8n\" (UniqueName: \"kubernetes.io/projected/75c9e2fc-13ee-45c0-824e-396644cb5fff-kube-api-access-cjt8n\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9307961d-04e4-4d29-8282-7a8099702591-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-bound-sa-token\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-image-registry-private-configuration\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8ds\" (UniqueName: \"kubernetes.io/projected/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-kube-api-access-zd8ds\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5761086-b3f2-4b2e-92c9-26462fdd9c31-ca-trust-extracted\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-default-certificate\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c9e2fc-13ee-45c0-824e-396644cb5fff-trusted-ca\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.658041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.657962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-certificates\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.658331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.658124    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5761086-b3f2-4b2e-92c9-26462fdd9c31-ca-trust-extracted\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.658331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.658145    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-trusted-ca\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.659633 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.659609    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-installation-pull-secrets\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.659862 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.659845    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-image-registry-private-configuration\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.666702 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.666676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-bound-sa-token\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.667127 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.667111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cvph\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-kube-api-access-9cvph\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:03.758175 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c9e2fc-13ee-45c0-824e-396644cb5fff-config\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.758175 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.758175 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.758334 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758261    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:04.258248346 +0000 UTC m=+236.514229338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : configmap references non-existent config key: service-ca.crt
Sep 12 02:40:03.758334 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758289    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-stats-auth\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.758454 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th8nw\" (UniqueName: \"kubernetes.io/projected/9307961d-04e4-4d29-8282-7a8099702591-kube-api-access-th8nw\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.758454 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758360    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 02:40:03.758454 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r69g\" (UniqueName: \"kubernetes.io/projected/dbcbff98-95b5-43d6-9967-d84e15a7dea0-kube-api-access-2r69g\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:03.758454 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758429    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:04.258394761 +0000 UTC m=+236.514375774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : secret "router-metrics-certs-default" not found
Sep 12 02:40:03.758667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758457    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjt8n\" (UniqueName: \"kubernetes.io/projected/75c9e2fc-13ee-45c0-824e-396644cb5fff-kube-api-access-cjt8n\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.758667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9307961d-04e4-4d29-8282-7a8099702591-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.758667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8ds\" (UniqueName: \"kubernetes.io/projected/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-kube-api-access-zd8ds\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.758667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758559    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-default-certificate\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.758667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c9e2fc-13ee-45c0-824e-396644cb5fff-trusted-ca\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.758667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75c9e2fc-13ee-45c0-824e-396644cb5fff-serving-cert\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.758781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c9e2fc-13ee-45c0-824e-396644cb5fff-config\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758816    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758858    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls podName:9307961d-04e4-4d29-8282-7a8099702591 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:04.258844062 +0000 UTC m=+236.514825073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-trs5z" (UID: "9307961d-04e4-4d29-8282-7a8099702591") : secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758869    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 02:40:03.759010 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:03.758923    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls podName:dbcbff98-95b5-43d6-9967-d84e15a7dea0 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:04.258908043 +0000 UTC m=+236.514889051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-kmtvr" (UID: "dbcbff98-95b5-43d6-9967-d84e15a7dea0") : secret "samples-operator-tls" not found
Sep 12 02:40:03.759370 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.759281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9307961d-04e4-4d29-8282-7a8099702591-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.759470 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.759452    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75c9e2fc-13ee-45c0-824e-396644cb5fff-trusted-ca\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.760755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.760734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-stats-auth\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.760866 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.760795    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75c9e2fc-13ee-45c0-824e-396644cb5fff-serving-cert\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.760923 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.760881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-default-certificate\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.766568 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.766550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8ds\" (UniqueName: \"kubernetes.io/projected/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-kube-api-access-zd8ds\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:03.766656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.766589    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th8nw\" (UniqueName: \"kubernetes.io/projected/9307961d-04e4-4d29-8282-7a8099702591-kube-api-access-th8nw\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:03.767309 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.767293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjt8n\" (UniqueName: \"kubernetes.io/projected/75c9e2fc-13ee-45c0-824e-396644cb5fff-kube-api-access-cjt8n\") pod \"console-operator-696884fb9c-r444n\" (UID: \"75c9e2fc-13ee-45c0-824e-396644cb5fff\") " pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:03.767451 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.767391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r69g\" (UniqueName: \"kubernetes.io/projected/dbcbff98-95b5-43d6-9967-d84e15a7dea0-kube-api-access-2r69g\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:03.871661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:03.871625    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:04.135875 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.135846    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-r444n"]
Sep 12 02:40:04.138628 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:04.138596    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c9e2fc_13ee_45c0_824e_396644cb5fff.slice/crio-59510aa65ee20a7e25aa507f897f32516c225836338df280605beac3ba35b093 WatchSource:0}: Error finding container 59510aa65ee20a7e25aa507f897f32516c225836338df280605beac3ba35b093: Status 404 returned error can't find the container with id 59510aa65ee20a7e25aa507f897f32516c225836338df280605beac3ba35b093
Sep 12 02:40:04.160516 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.160493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:04.160623 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.160610    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 02:40:04.160668 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.160625    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfc648fc5-xmhrr: secret "image-registry-tls" not found
Sep 12 02:40:04.160701 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.160678    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls podName:e5761086-b3f2-4b2e-92c9-26462fdd9c31 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:05.160661965 +0000 UTC m=+237.416642960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls") pod "image-registry-6bfc648fc5-xmhrr" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31") : secret "image-registry-tls" not found
Sep 12 02:40:04.261277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.261255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:04.261358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.261284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:04.261397 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.261358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:04.261463 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261430    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:05.261393849 +0000 UTC m=+237.517374853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : configmap references non-existent config key: service-ca.crt
Sep 12 02:40:04.261509 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261481    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 02:40:04.261546 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.261505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:04.261546 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261541    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls podName:dbcbff98-95b5-43d6-9967-d84e15a7dea0 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:05.261528795 +0000 UTC m=+237.517509793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-kmtvr" (UID: "dbcbff98-95b5-43d6-9967-d84e15a7dea0") : secret "samples-operator-tls" not found
Sep 12 02:40:04.261617 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261484    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 02:40:04.261617 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261577    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:05.261567757 +0000 UTC m=+237.517548750 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : secret "router-metrics-certs-default" not found
Sep 12 02:40:04.261617 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261582    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:04.261720 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:04.261632    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls podName:9307961d-04e4-4d29-8282-7a8099702591 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:05.261617917 +0000 UTC m=+237.517598926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-trs5z" (UID: "9307961d-04e4-4d29-8282-7a8099702591") : secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:04.970513 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:04.970472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-r444n" event={"ID":"75c9e2fc-13ee-45c0-824e-396644cb5fff","Type":"ContainerStarted","Data":"59510aa65ee20a7e25aa507f897f32516c225836338df280605beac3ba35b093"}
Sep 12 02:40:05.168242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:05.168208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:05.168422 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.168365    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 02:40:05.168422 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.168384    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfc648fc5-xmhrr: secret "image-registry-tls" not found
Sep 12 02:40:05.168527 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.168455    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls podName:e5761086-b3f2-4b2e-92c9-26462fdd9c31 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:07.168439056 +0000 UTC m=+239.424420048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls") pod "image-registry-6bfc648fc5-xmhrr" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31") : secret "image-registry-tls" not found
Sep 12 02:40:05.269106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:05.269016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:05.269106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:05.269078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:05.269135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:05.269163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269184    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269219    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269258    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269255    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls podName:dbcbff98-95b5-43d6-9967-d84e15a7dea0 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:07.269236107 +0000 UTC m=+239.525217102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-kmtvr" (UID: "dbcbff98-95b5-43d6-9967-d84e15a7dea0") : secret "samples-operator-tls" not found
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269294    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:07.26927258 +0000 UTC m=+239.525253597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : configmap references non-existent config key: service-ca.crt
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269322    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls podName:9307961d-04e4-4d29-8282-7a8099702591 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:07.269311681 +0000 UTC m=+239.525292677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-trs5z" (UID: "9307961d-04e4-4d29-8282-7a8099702591") : secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:05.269450 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:05.269337    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:07.269327969 +0000 UTC m=+239.525308966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : secret "router-metrics-certs-default" not found
Sep 12 02:40:06.977927 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:06.977899    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/0.log"
Sep 12 02:40:06.978272 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:06.977937    2583 generic.go:356] "Generic (PLEG): container finished" podID="75c9e2fc-13ee-45c0-824e-396644cb5fff" containerID="a3f392ea51d984a3a3f0a8495e1966f2fca25329f4d1c33fdc3816e2325924c7" exitCode=255
Sep 12 02:40:06.978272 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:06.977967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-r444n" event={"ID":"75c9e2fc-13ee-45c0-824e-396644cb5fff","Type":"ContainerDied","Data":"a3f392ea51d984a3a3f0a8495e1966f2fca25329f4d1c33fdc3816e2325924c7"}
Sep 12 02:40:06.978272 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:06.978209    2583 scope.go:117] "RemoveContainer" containerID="a3f392ea51d984a3a3f0a8495e1966f2fca25329f4d1c33fdc3816e2325924c7"
Sep 12 02:40:07.185332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.185308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:07.185473 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.185455    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 02:40:07.185513 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.185475    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfc648fc5-xmhrr: secret "image-registry-tls" not found
Sep 12 02:40:07.185552 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.185521    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls podName:e5761086-b3f2-4b2e-92c9-26462fdd9c31 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.185507299 +0000 UTC m=+243.441488293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls") pod "image-registry-6bfc648fc5-xmhrr" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31") : secret "image-registry-tls" not found
Sep 12 02:40:07.286118 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.286044    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:07.286118 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.286103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.286141    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.286169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286188    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286238    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286257    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls podName:dbcbff98-95b5-43d6-9967-d84e15a7dea0 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.286236973 +0000 UTC m=+243.542217966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-kmtvr" (UID: "dbcbff98-95b5-43d6-9967-d84e15a7dea0") : secret "samples-operator-tls" not found
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286276    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls podName:9307961d-04e4-4d29-8282-7a8099702591 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.28626543 +0000 UTC m=+243.542246428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-trs5z" (UID: "9307961d-04e4-4d29-8282-7a8099702591") : secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:07.286299 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286296    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.286285774 +0000 UTC m=+243.542266766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : configmap references non-existent config key: service-ca.crt
Sep 12 02:40:07.286585 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286326    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 02:40:07.286585 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.286380    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.286363818 +0000 UTC m=+243.542344833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : secret "router-metrics-certs-default" not found
Sep 12 02:40:07.982757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.982734    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/1.log"
Sep 12 02:40:07.983136 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.983122    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/0.log"
Sep 12 02:40:07.983184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.983153    2583 generic.go:356] "Generic (PLEG): container finished" podID="75c9e2fc-13ee-45c0-824e-396644cb5fff" containerID="f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc" exitCode=255
Sep 12 02:40:07.983184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.983176    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-r444n" event={"ID":"75c9e2fc-13ee-45c0-824e-396644cb5fff","Type":"ContainerDied","Data":"f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc"}
Sep 12 02:40:07.983265 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.983216    2583 scope.go:117] "RemoveContainer" containerID="a3f392ea51d984a3a3f0a8495e1966f2fca25329f4d1c33fdc3816e2325924c7"
Sep 12 02:40:07.983485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:07.983465    2583 scope.go:117] "RemoveContainer" containerID="f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc"
Sep 12 02:40:07.983655 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:07.983638    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-r444n_openshift-console-operator(75c9e2fc-13ee-45c0-824e-396644cb5fff)\"" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podUID="75c9e2fc-13ee-45c0-824e-396644cb5fff"
Sep 12 02:40:08.110911 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.110877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l24rx"]
Sep 12 02:40:08.115023 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.115004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.118534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.118517    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 12 02:40:08.119055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.119041    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 12 02:40:08.122825 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.122805    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-klkm9\""
Sep 12 02:40:08.123092 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.123071    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 12 02:40:08.123236 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.123221    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 12 02:40:08.141771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.141753    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l24rx"]
Sep 12 02:40:08.192812 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.192791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24bm6\" (UniqueName: \"kubernetes.io/projected/1e3e4461-d584-4220-8322-805358ceda2d-kube-api-access-24bm6\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.192919 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.192823    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3e4461-d584-4220-8322-805358ceda2d-data-volume\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.192919 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.192905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e3e4461-d584-4220-8322-805358ceda2d-crio-socket\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.192988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.192933    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.192988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.192953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.293632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24bm6\" (UniqueName: \"kubernetes.io/projected/1e3e4461-d584-4220-8322-805358ceda2d-kube-api-access-24bm6\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.293632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3e4461-d584-4220-8322-805358ceda2d-data-volume\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.293781 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e3e4461-d584-4220-8322-805358ceda2d-crio-socket\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.293781 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.293781 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.293781 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.293763    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 02:40:08.293781 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e3e4461-d584-4220-8322-805358ceda2d-crio-socket\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.294020 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.293816    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:08.793798904 +0000 UTC m=+241.049779914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : configmap "kube-rbac-proxy" not found
Sep 12 02:40:08.294020 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.293829    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:08.294020 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.293887    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:08.793870013 +0000 UTC m=+241.049851010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:08.294020 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.293981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e3e4461-d584-4220-8322-805358ceda2d-data-volume\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.303352 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.303326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24bm6\" (UniqueName: \"kubernetes.io/projected/1e3e4461-d584-4220-8322-805358ceda2d-kube-api-access-24bm6\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.797533 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.797479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.797533 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.797534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:08.797774 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.797622    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:08.797774 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.797645    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 02:40:08.797774 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.797697    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:09.797681999 +0000 UTC m=+242.053662997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:08.797774 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.797711    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:09.797705063 +0000 UTC m=+242.053686055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : configmap "kube-rbac-proxy" not found
Sep 12 02:40:08.987800 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.987775    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/1.log"
Sep 12 02:40:08.988120 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:08.988066    2583 scope.go:117] "RemoveContainer" containerID="f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc"
Sep 12 02:40:08.988220 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:08.988203    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-r444n_openshift-console-operator(75c9e2fc-13ee-45c0-824e-396644cb5fff)\"" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podUID="75c9e2fc-13ee-45c0-824e-396644cb5fff"
Sep 12 02:40:09.804288 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:09.804260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:09.804288 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:09.804292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:09.804550 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:09.804364    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 02:40:09.804550 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:09.804431    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.804400803 +0000 UTC m=+244.060381810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : configmap "kube-rbac-proxy" not found
Sep 12 02:40:09.804550 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:09.804441    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:09.804550 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:09.804505    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:11.804488538 +0000 UTC m=+244.060469543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:10.071826 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:10.071798    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gm5gm_e65fb995-c074-4c75-8709-e11ad8ddd764/dns-node-resolver/0.log"
Sep 12 02:40:11.216022 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.215989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:11.216377 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.216094    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 12 02:40:11.216377 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.216104    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bfc648fc5-xmhrr: secret "image-registry-tls" not found
Sep 12 02:40:11.216377 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.216157    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls podName:e5761086-b3f2-4b2e-92c9-26462fdd9c31 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:19.216144241 +0000 UTC m=+251.472125247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls") pod "image-registry-6bfc648fc5-xmhrr" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31") : secret "image-registry-tls" not found
Sep 12 02:40:11.271492 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.271467    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zg9wj_20f66744-7567-4321-a774-8b0c260e5477/node-ca/0.log"
Sep 12 02:40:11.316842 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.316818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:11.316922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.316872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:11.316974 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.316947    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:11.316974 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.316964    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 12 02:40:11.317076 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.316990    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls podName:9307961d-04e4-4d29-8282-7a8099702591 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:19.316978902 +0000 UTC m=+251.572959908 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-trs5z" (UID: "9307961d-04e4-4d29-8282-7a8099702591") : secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:11.317076 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.317035    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls podName:dbcbff98-95b5-43d6-9967-d84e15a7dea0 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:19.317015892 +0000 UTC m=+251.572996899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-kmtvr" (UID: "dbcbff98-95b5-43d6-9967-d84e15a7dea0") : secret "samples-operator-tls" not found
Sep 12 02:40:11.317076 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.317059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:11.317241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.317092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:11.317241 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.317187    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:19.317174577 +0000 UTC m=+251.573155574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : configmap references non-existent config key: service-ca.crt
Sep 12 02:40:11.317241 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.317230    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 12 02:40:11.317360 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.317276    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs podName:3b1b4539-0a79-4ad3-b093-0fe4994f04dd nodeName:}" failed. No retries permitted until 2026-09-12 02:40:19.317262614 +0000 UTC m=+251.573243627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs") pod "router-default-f78d98684-sxr7z" (UID: "3b1b4539-0a79-4ad3-b093-0fe4994f04dd") : secret "router-metrics-certs-default" not found
Sep 12 02:40:11.820340 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.820305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:11.820340 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:11.820340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:11.820550 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.820462    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:11.820550 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.820520    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:15.820506775 +0000 UTC m=+248.076487781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:11.820620 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.820465    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 02:40:11.820620 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:11.820602    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:15.820589932 +0000 UTC m=+248.076570924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : configmap "kube-rbac-proxy" not found
Sep 12 02:40:12.071826 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:12.071748    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xwmwg_fd7accf5-b2b2-4bc6-826e-25cd48d6444d/serve-healthcheck-canary/0.log"
Sep 12 02:40:13.871976 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:13.871942    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:13.872335 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:13.871999    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:13.872335 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:13.872308    2583 scope.go:117] "RemoveContainer" containerID="f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc"
Sep 12 02:40:13.872479 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:13.872462    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-r444n_openshift-console-operator(75c9e2fc-13ee-45c0-824e-396644cb5fff)\"" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podUID="75c9e2fc-13ee-45c0-824e-396644cb5fff"
Sep 12 02:40:15.854584 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:15.854540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:15.854584 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:15.854586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:15.855031 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:15.854686    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 12 02:40:15.855031 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:15.854707    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:15.855031 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:15.854751    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:23.854733433 +0000 UTC m=+256.110714444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : configmap "kube-rbac-proxy" not found
Sep 12 02:40:15.855031 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:15.854767    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls podName:1e3e4461-d584-4220-8322-805358ceda2d nodeName:}" failed. No retries permitted until 2026-09-12 02:40:23.854760664 +0000 UTC m=+256.110741657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l24rx" (UID: "1e3e4461-d584-4220-8322-805358ceda2d") : secret "insights-runtime-extractor-tls" not found
Sep 12 02:40:18.980886 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:18.980851    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:40:18.981276 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:18.980997    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 12 02:40:18.981276 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:18.981055    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs podName:79a51ccb-246e-44da-9d05-ec1c2a395d1a nodeName:}" failed. No retries permitted until 2026-09-12 02:42:20.981040266 +0000 UTC m=+373.237021258 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs") pod "network-metrics-daemon-vt47l" (UID: "79a51ccb-246e-44da-9d05-ec1c2a395d1a") : secret "metrics-daemon-secret" not found
Sep 12 02:40:19.282943 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.282838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:19.285317 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.285293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"image-registry-6bfc648fc5-xmhrr\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") " pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:19.365065 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.365037    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jtp6k\""
Sep 12 02:40:19.372783 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.372753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:19.383326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.383306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:19.383401 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.383361    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:19.383467 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.383447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:19.383503 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.383486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:19.383617 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:19.383596    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:19.383692 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:19.383679    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls podName:9307961d-04e4-4d29-8282-7a8099702591 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:35.383656708 +0000 UTC m=+267.639637718 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-trs5z" (UID: "9307961d-04e4-4d29-8282-7a8099702591") : secret "cluster-monitoring-operator-tls" not found
Sep 12 02:40:19.384244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.384165    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-service-ca-bundle\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:19.386322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.386301    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/dbcbff98-95b5-43d6-9967-d84e15a7dea0-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-kmtvr\" (UID: \"dbcbff98-95b5-43d6-9967-d84e15a7dea0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:19.386429 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.386343    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b1b4539-0a79-4ad3-b093-0fe4994f04dd-metrics-certs\") pod \"router-default-f78d98684-sxr7z\" (UID: \"3b1b4539-0a79-4ad3-b093-0fe4994f04dd\") " pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:19.467172 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.467144    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-d27rp\""
Sep 12 02:40:19.475069 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.475048    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"
Sep 12 02:40:19.478235 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.478216    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b8rwm\""
Sep 12 02:40:19.486615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.486595    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:19.643689 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.643658    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bfc648fc5-xmhrr"]
Sep 12 02:40:19.646566 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:19.646545    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5761086_b3f2_4b2e_92c9_26462fdd9c31.slice/crio-a273e85d0665856d3b5e822069fa1df15de5fb04642d7bc1321b765c40bcf596 WatchSource:0}: Error finding container a273e85d0665856d3b5e822069fa1df15de5fb04642d7bc1321b765c40bcf596: Status 404 returned error can't find the container with id a273e85d0665856d3b5e822069fa1df15de5fb04642d7bc1321b765c40bcf596
Sep 12 02:40:19.742823 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.742796    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr"]
Sep 12 02:40:19.764315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:19.764287    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f78d98684-sxr7z"]
Sep 12 02:40:19.777401 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:19.777372    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1b4539_0a79_4ad3_b093_0fe4994f04dd.slice/crio-ccd8ea8723030e65c6b73c8dc57494c4dace4f8833b26a5c7fabdec89a7a26ee WatchSource:0}: Error finding container ccd8ea8723030e65c6b73c8dc57494c4dace4f8833b26a5c7fabdec89a7a26ee: Status 404 returned error can't find the container with id ccd8ea8723030e65c6b73c8dc57494c4dace4f8833b26a5c7fabdec89a7a26ee
Sep 12 02:40:20.021339 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.021304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f78d98684-sxr7z" event={"ID":"3b1b4539-0a79-4ad3-b093-0fe4994f04dd","Type":"ContainerStarted","Data":"bc32d719053e6430224db0d27d49635548ae43f07982624eefe5342cf282addb"}
Sep 12 02:40:20.021784 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.021360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f78d98684-sxr7z" event={"ID":"3b1b4539-0a79-4ad3-b093-0fe4994f04dd","Type":"ContainerStarted","Data":"ccd8ea8723030e65c6b73c8dc57494c4dace4f8833b26a5c7fabdec89a7a26ee"}
Sep 12 02:40:20.022667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.022634    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr" event={"ID":"dbcbff98-95b5-43d6-9967-d84e15a7dea0","Type":"ContainerStarted","Data":"fab381bd3b40a6456954e9f60b7568dd354ca5da8caa3a2e681fe0f34c358c93"}
Sep 12 02:40:20.024053 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.024020    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" event={"ID":"e5761086-b3f2-4b2e-92c9-26462fdd9c31","Type":"ContainerStarted","Data":"95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3"}
Sep 12 02:40:20.024160 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.024056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" event={"ID":"e5761086-b3f2-4b2e-92c9-26462fdd9c31","Type":"ContainerStarted","Data":"a273e85d0665856d3b5e822069fa1df15de5fb04642d7bc1321b765c40bcf596"}
Sep 12 02:40:20.024160 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.024089    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:20.040677 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.040634    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f78d98684-sxr7z" podStartSLOduration=17.040621533 podStartE2EDuration="17.040621533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:20.039811634 +0000 UTC m=+252.295792648" watchObservedRunningTime="2026-09-12 02:40:20.040621533 +0000 UTC m=+252.296602547"
Sep 12 02:40:20.056245 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.056180    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" podStartSLOduration=17.05616824 podStartE2EDuration="17.05616824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:20.055242441 +0000 UTC m=+252.311223447" watchObservedRunningTime="2026-09-12 02:40:20.05616824 +0000 UTC m=+252.312149246"
Sep 12 02:40:20.487438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.487385    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:20.490216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:20.490195    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:21.028037 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:21.027976    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:21.029190 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:21.029167    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f78d98684-sxr7z"
Sep 12 02:40:22.032589 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:22.032553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr" event={"ID":"dbcbff98-95b5-43d6-9967-d84e15a7dea0","Type":"ContainerStarted","Data":"fd6a71b6240f79bf71e04ef7ca2ddeb24f54effb373873c73a6e3bb5840ceef1"}
Sep 12 02:40:22.032959 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:22.032635    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr" event={"ID":"dbcbff98-95b5-43d6-9967-d84e15a7dea0","Type":"ContainerStarted","Data":"560c352e3a0a66f5fd38a504ea874fc96147343194e3c45890441b5f8e59afdf"}
Sep 12 02:40:22.047895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:22.047849    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-kmtvr" podStartSLOduration=17.515058184 podStartE2EDuration="19.047834891s" totalImagesPullingTime="1.532776707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:22.046713084 +0000 UTC m=+254.302694103" watchObservedRunningTime="2026-09-12 02:40:22.047834891 +0000 UTC m=+254.303815905"
Sep 12 02:40:23.924080 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:23.924035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:23.924080 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:23.924084    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:23.924625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:23.924606    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e3e4461-d584-4220-8322-805358ceda2d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:23.926363 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:23.926339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e3e4461-d584-4220-8322-805358ceda2d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l24rx\" (UID: \"1e3e4461-d584-4220-8322-805358ceda2d\") " pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:24.023422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:24.023372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l24rx"
Sep 12 02:40:24.289617 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:24.289539    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l24rx"]
Sep 12 02:40:24.293009 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:24.292976    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3e4461_d584_4220_8322_805358ceda2d.slice/crio-6bc733ee81c542175837861aee73e23615261955b2c2f4a27a5efe4161ad1cdd WatchSource:0}: Error finding container 6bc733ee81c542175837861aee73e23615261955b2c2f4a27a5efe4161ad1cdd: Status 404 returned error can't find the container with id 6bc733ee81c542175837861aee73e23615261955b2c2f4a27a5efe4161ad1cdd
Sep 12 02:40:25.044166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:25.044142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l24rx" event={"ID":"1e3e4461-d584-4220-8322-805358ceda2d","Type":"ContainerStarted","Data":"7ebfc647309d7981527bc4951bd4b22f973c28ab197cd5f7d27740dd27b968db"}
Sep 12 02:40:25.044471 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:25.044194    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l24rx" event={"ID":"1e3e4461-d584-4220-8322-805358ceda2d","Type":"ContainerStarted","Data":"6bc733ee81c542175837861aee73e23615261955b2c2f4a27a5efe4161ad1cdd"}
Sep 12 02:40:26.050950 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:26.050896    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l24rx" event={"ID":"1e3e4461-d584-4220-8322-805358ceda2d","Type":"ContainerStarted","Data":"cf1899a919282a632909bda4c47dba4ad44bb68ac781097dc0d65c9fd9680a1d"}
Sep 12 02:40:27.056095 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:27.056054    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l24rx" event={"ID":"1e3e4461-d584-4220-8322-805358ceda2d","Type":"ContainerStarted","Data":"13387e0bb4ace31e8ddf3763e9a0e797bbdcf81ec3b54ba2cbc9283662e656cb"}
Sep 12 02:40:27.072999 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:27.072945    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l24rx" podStartSLOduration=17.016479808 podStartE2EDuration="19.072923514s" totalImagesPullingTime="2.056443706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 02:40:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:27.07292273 +0000 UTC m=+259.328903746" watchObservedRunningTime="2026-09-12 02:40:27.072923514 +0000 UTC m=+259.328904530"
Sep 12 02:40:27.155615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:27.155591    2583 scope.go:117] "RemoveContainer" containerID="f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc"
Sep 12 02:40:28.060527 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:28.060500    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:40:28.060909 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:28.060894    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/1.log"
Sep 12 02:40:28.060958 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:28.060926    2583 generic.go:356] "Generic (PLEG): container finished" podID="75c9e2fc-13ee-45c0-824e-396644cb5fff" containerID="19914a37fd79d6eb107271aeefe6262400af165d4fd2b21bc80cc1c595a497ea" exitCode=255
Sep 12 02:40:28.061022 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:28.061002    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-r444n" event={"ID":"75c9e2fc-13ee-45c0-824e-396644cb5fff","Type":"ContainerDied","Data":"19914a37fd79d6eb107271aeefe6262400af165d4fd2b21bc80cc1c595a497ea"}
Sep 12 02:40:28.061073 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:28.061061    2583 scope.go:117] "RemoveContainer" containerID="f027f2815893e6ecf6f76fb6c5218313ff7c8f995e1f3c7ec594692b247162fc"
Sep 12 02:40:28.061439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:28.061399    2583 scope.go:117] "RemoveContainer" containerID="19914a37fd79d6eb107271aeefe6262400af165d4fd2b21bc80cc1c595a497ea"
Sep 12 02:40:28.061602 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:28.061586    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-r444n_openshift-console-operator(75c9e2fc-13ee-45c0-824e-396644cb5fff)\"" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podUID="75c9e2fc-13ee-45c0-824e-396644cb5fff"
Sep 12 02:40:29.066020 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:29.065995    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:40:31.295164 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:31.295089    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bfc648fc5-xmhrr"]
Sep 12 02:40:33.872530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:33.872477    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:33.872530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:33.872542    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:33.872991 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:33.872817    2583 scope.go:117] "RemoveContainer" containerID="19914a37fd79d6eb107271aeefe6262400af165d4fd2b21bc80cc1c595a497ea"
Sep 12 02:40:33.872991 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:33.872972    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-r444n_openshift-console-operator(75c9e2fc-13ee-45c0-824e-396644cb5fff)\"" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podUID="75c9e2fc-13ee-45c0-824e-396644cb5fff"
Sep 12 02:40:35.412958 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:35.412924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:35.415355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:35.415332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9307961d-04e4-4d29-8282-7a8099702591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-trs5z\" (UID: \"9307961d-04e4-4d29-8282-7a8099702591\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:35.660123 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:35.660085    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6vz55\""
Sep 12 02:40:35.668244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:35.668176    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"
Sep 12 02:40:35.935582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:35.935499    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z"]
Sep 12 02:40:35.939322 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:35.939295    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9307961d_04e4_4d29_8282_7a8099702591.slice/crio-d20f2c6c50c2f8895979ec79a8c23111a88c5acd7b0ef95dba1ff78c35e3158e WatchSource:0}: Error finding container d20f2c6c50c2f8895979ec79a8c23111a88c5acd7b0ef95dba1ff78c35e3158e: Status 404 returned error can't find the container with id d20f2c6c50c2f8895979ec79a8c23111a88c5acd7b0ef95dba1ff78c35e3158e
Sep 12 02:40:36.089106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:36.089064    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z" event={"ID":"9307961d-04e4-4d29-8282-7a8099702591","Type":"ContainerStarted","Data":"d20f2c6c50c2f8895979ec79a8c23111a88c5acd7b0ef95dba1ff78c35e3158e"}
Sep 12 02:40:38.059648 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.058002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"]
Sep 12 02:40:38.061779 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.061751    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:38.064053 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.064033    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 12 02:40:38.064053 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.064040    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8cj5d\""
Sep 12 02:40:38.066121 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.066098    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"]
Sep 12 02:40:38.096677 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.096653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z" event={"ID":"9307961d-04e4-4d29-8282-7a8099702591","Type":"ContainerStarted","Data":"e1e4cf2c15361778905988fdd1df2701755a471dd68c2abeded20aa4606c0a16"}
Sep 12 02:40:38.111079 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.111038    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-trs5z" podStartSLOduration=33.466915152 podStartE2EDuration="35.111025886s" totalImagesPullingTime="1.644110734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:38.110662272 +0000 UTC m=+270.366643289" watchObservedRunningTime="2026-09-12 02:40:38.111025886 +0000 UTC m=+270.367006901"
Sep 12 02:40:38.238171 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.238117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c5af412-dead-4502-acee-dfe92bb8d385-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zcstb\" (UID: \"5c5af412-dead-4502-acee-dfe92bb8d385\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:38.338707 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.338676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c5af412-dead-4502-acee-dfe92bb8d385-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zcstb\" (UID: \"5c5af412-dead-4502-acee-dfe92bb8d385\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:38.340915 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.340897    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5c5af412-dead-4502-acee-dfe92bb8d385-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-zcstb\" (UID: \"5c5af412-dead-4502-acee-dfe92bb8d385\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:38.370995 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.370970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:38.634683 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:38.634602    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"]
Sep 12 02:40:38.637448 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:38.637400    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c5af412_dead_4502_acee_dfe92bb8d385.slice/crio-a322792542772672f08b1bb9fc4394a3b2f63950453e1fa6c40a332d8d642863 WatchSource:0}: Error finding container a322792542772672f08b1bb9fc4394a3b2f63950453e1fa6c40a332d8d642863: Status 404 returned error can't find the container with id a322792542772672f08b1bb9fc4394a3b2f63950453e1fa6c40a332d8d642863
Sep 12 02:40:39.102012 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:39.101973    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb" event={"ID":"5c5af412-dead-4502-acee-dfe92bb8d385","Type":"ContainerStarted","Data":"a322792542772672f08b1bb9fc4394a3b2f63950453e1fa6c40a332d8d642863"}
Sep 12 02:40:40.106573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:40.106533    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb" event={"ID":"5c5af412-dead-4502-acee-dfe92bb8d385","Type":"ContainerStarted","Data":"34089643394c4c622a046480674b317c45cca37b05667f719f1748191cb0d6ff"}
Sep 12 02:40:40.106938 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:40.106737    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:40.111216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:40.111195    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb"
Sep 12 02:40:40.124177 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:40.124137    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-zcstb" podStartSLOduration=1.23241311 podStartE2EDuration="2.124123305s" totalImagesPullingTime="891.710195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:40.123635042 +0000 UTC m=+272.379616058" watchObservedRunningTime="2026-09-12 02:40:40.124123305 +0000 UTC m=+272.380104317"
Sep 12 02:40:41.109259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.109221    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"]
Sep 12 02:40:41.112444 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.112428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.116152 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.116132    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 12 02:40:41.116152 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.116144    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 12 02:40:41.116322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.116134    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 12 02:40:41.116322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.116143    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9zvvv\""
Sep 12 02:40:41.120079 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.120059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"]
Sep 12 02:40:41.260963 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.260926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a509e95-5d49-47aa-b160-989d511c63c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.261143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.261087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a509e95-5d49-47aa-b160-989d511c63c2-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.261143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.261129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c57p\" (UniqueName: \"kubernetes.io/projected/1a509e95-5d49-47aa-b160-989d511c63c2-kube-api-access-7c57p\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.261231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.261180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a509e95-5d49-47aa-b160-989d511c63c2-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.301582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.301553    2583 patch_prober.go:28] interesting pod/image-registry-6bfc648fc5-xmhrr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 12 02:40:41.301720 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.301601    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 02:40:41.362486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.362424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a509e95-5d49-47aa-b160-989d511c63c2-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.362486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.362482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a509e95-5d49-47aa-b160-989d511c63c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.362620 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.362526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a509e95-5d49-47aa-b160-989d511c63c2-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.362620 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.362556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c57p\" (UniqueName: \"kubernetes.io/projected/1a509e95-5d49-47aa-b160-989d511c63c2-kube-api-access-7c57p\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.363177 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.363154    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a509e95-5d49-47aa-b160-989d511c63c2-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.364778 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.364761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a509e95-5d49-47aa-b160-989d511c63c2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.364892 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.364876    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1a509e95-5d49-47aa-b160-989d511c63c2-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.377972 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.377950    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c57p\" (UniqueName: \"kubernetes.io/projected/1a509e95-5d49-47aa-b160-989d511c63c2-kube-api-access-7c57p\") pod \"prometheus-operator-68bcd7f987-s7zmc\" (UID: \"1a509e95-5d49-47aa-b160-989d511c63c2\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.420725 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.420698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"
Sep 12 02:40:41.686265 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:41.686189    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc"]
Sep 12 02:40:41.688840 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:41.688809    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a509e95_5d49_47aa_b160_989d511c63c2.slice/crio-99042119a102992c9626bdd4ba626a7cec6f09177cf0a6f61e2e34e2448da4d5 WatchSource:0}: Error finding container 99042119a102992c9626bdd4ba626a7cec6f09177cf0a6f61e2e34e2448da4d5: Status 404 returned error can't find the container with id 99042119a102992c9626bdd4ba626a7cec6f09177cf0a6f61e2e34e2448da4d5
Sep 12 02:40:42.116246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:42.116200    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc" event={"ID":"1a509e95-5d49-47aa-b160-989d511c63c2","Type":"ContainerStarted","Data":"99042119a102992c9626bdd4ba626a7cec6f09177cf0a6f61e2e34e2448da4d5"}
Sep 12 02:40:43.120832 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:43.120796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc" event={"ID":"1a509e95-5d49-47aa-b160-989d511c63c2","Type":"ContainerStarted","Data":"7ca7a0205a6ba88ca65064c8096d320e82acc96c9b0d7962b28a019052cf11a9"}
Sep 12 02:40:43.121202 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:43.120850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc" event={"ID":"1a509e95-5d49-47aa-b160-989d511c63c2","Type":"ContainerStarted","Data":"0003481ca37ff09fed8a960ff5220e49bedd64eb2143c616d604ad0c09e54403"}
Sep 12 02:40:43.137749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:43.137702    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-s7zmc" podStartSLOduration=1.054544315 podStartE2EDuration="2.137687652s" totalImagesPullingTime="1.083143337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:43.135982363 +0000 UTC m=+275.391963379" watchObservedRunningTime="2026-09-12 02:40:43.137687652 +0000 UTC m=+275.393668667"
Sep 12 02:40:45.466312 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.466275    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-h9frt"]
Sep 12 02:40:45.469626 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.469607    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.472663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.472640    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 12 02:40:45.472773 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.472673    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 12 02:40:45.472773 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.472744    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gqzx9\""
Sep 12 02:40:45.473401 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.473383    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 12 02:40:45.596421 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-wtmp\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596574 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596574 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-sys\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596574 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-metrics-client-ca\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596574 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596531    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596738 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kp7f\" (UniqueName: \"kubernetes.io/projected/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-kube-api-access-7kp7f\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596738 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-tls\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596738 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596649    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-root\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.596738 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.596664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-textfile\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697770 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-wtmp\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-sys\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-metrics-client-ca\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697903    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-wtmp\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.697940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kp7f\" (UniqueName: \"kubernetes.io/projected/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-kube-api-access-7kp7f\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698252 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697944    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-sys\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698252 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.697966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-tls\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698252 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.698000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-root\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698252 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.698024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-textfile\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698488 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.698276    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-root\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698488 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.698364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-textfile\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698574 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.698500    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-accelerators-collector-config\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.698574 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.698554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-metrics-client-ca\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.700750 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.700726    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.700849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.700790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-node-exporter-tls\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.706443 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.706395    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kp7f\" (UniqueName: \"kubernetes.io/projected/601447d7-cda0-46aa-93a1-c0c55cf6dcf4-kube-api-access-7kp7f\") pod \"node-exporter-h9frt\" (UID: \"601447d7-cda0-46aa-93a1-c0c55cf6dcf4\") " pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.778258 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:45.778189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-h9frt"
Sep 12 02:40:45.789984 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:45.789962    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601447d7_cda0_46aa_93a1_c0c55cf6dcf4.slice/crio-6e8017c085f1847d2bd51baca0ec0d7d118cd841715c345a3f9cf107926e51ba WatchSource:0}: Error finding container 6e8017c085f1847d2bd51baca0ec0d7d118cd841715c345a3f9cf107926e51ba: Status 404 returned error can't find the container with id 6e8017c085f1847d2bd51baca0ec0d7d118cd841715c345a3f9cf107926e51ba
Sep 12 02:40:46.131732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.131695    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h9frt" event={"ID":"601447d7-cda0-46aa-93a1-c0c55cf6dcf4","Type":"ContainerStarted","Data":"6e8017c085f1847d2bd51baca0ec0d7d118cd841715c345a3f9cf107926e51ba"}
Sep 12 02:40:46.518142 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.518066    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:40:46.528182 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.523796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.528423 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.528379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 12 02:40:46.528650 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.528617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h4g6k\""
Sep 12 02:40:46.528713 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.528661    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 12 02:40:46.528713 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.528674    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 12 02:40:46.528816 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.528800    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 12 02:40:46.530957 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.530915    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 12 02:40:46.531137 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.531108    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 12 02:40:46.531241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.531224    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 12 02:40:46.531505 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.531488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 12 02:40:46.532488 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.532471    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 12 02:40:46.536153 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.536133    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:40:46.605755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605695    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-web-config\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-volume\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605801    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605861    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd4h9\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-kube-api-access-rd4h9\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.605952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.606244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.605987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.606244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.606017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-out\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.606244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.606035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.606244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.606158    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.606244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.606202    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.706942 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.706909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.706993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707029    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-web-config\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707074    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-volume\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd4h9\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-kube-api-access-rd4h9\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.707359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-out\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.708386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.707965    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.708386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.708342    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.708571 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:46.708490    2583 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 12 02:40:46.708571 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:46.708558    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls podName:caabae0e-f30c-41f2-b6fe-fd98bc125134 nodeName:}" failed. No retries permitted until 2026-09-12 02:40:47.208537371 +0000 UTC m=+279.464518366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134") : secret "alertmanager-main-tls" not found
Sep 12 02:40:46.709300 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.709253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.710963 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.710939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-web-config\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.711180 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.711125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.712242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.712032    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-out\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.712242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.712170    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-volume\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.712242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.712192    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.712730 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.712705    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.712831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.712771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.713123 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.713100    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:46.720174 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:46.720136    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd4h9\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-kube-api-access-rd4h9\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:47.139644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.139614    2583 generic.go:356] "Generic (PLEG): container finished" podID="601447d7-cda0-46aa-93a1-c0c55cf6dcf4" containerID="e341d909561ea0045aefad68139eb8cafe6d74c15b8dd466ff4ae5d2d34540c8" exitCode=0
Sep 12 02:40:47.139808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.139692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h9frt" event={"ID":"601447d7-cda0-46aa-93a1-c0c55cf6dcf4","Type":"ContainerDied","Data":"e341d909561ea0045aefad68139eb8cafe6d74c15b8dd466ff4ae5d2d34540c8"}
Sep 12 02:40:47.154624 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.154601    2583 scope.go:117] "RemoveContainer" containerID="19914a37fd79d6eb107271aeefe6262400af165d4fd2b21bc80cc1c595a497ea"
Sep 12 02:40:47.154793 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:47.154774    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-r444n_openshift-console-operator(75c9e2fc-13ee-45c0-824e-396644cb5fff)\"" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podUID="75c9e2fc-13ee-45c0-824e-396644cb5fff"
Sep 12 02:40:47.212971 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.212662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:47.214962 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.214942    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:47.430963 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.430891    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"]
Sep 12 02:40:47.434468 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.434450    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.436865 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.436841    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 12 02:40:47.436990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.436953    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cbneno5jmk2jd\""
Sep 12 02:40:47.436990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.436982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 12 02:40:47.437101 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.436999    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4vrj2\""
Sep 12 02:40:47.437206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.437181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 12 02:40:47.437346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.437317    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 12 02:40:47.437441 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.437377    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 12 02:40:47.442396 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.442379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:40:47.448236 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.448217    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"]
Sep 12 02:40:47.515894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.515867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516014 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.515902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516014 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.515924    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-tls\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516014 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.515999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.516052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/183f965b-e5b7-4a07-8469-c2e5b7cc077d-metrics-client-ca\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.516069    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plr4w\" (UniqueName: \"kubernetes.io/projected/183f965b-e5b7-4a07-8469-c2e5b7cc077d-kube-api-access-plr4w\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.516124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-grpc-tls\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.516166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.516146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-grpc-tls\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-tls\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.617831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/183f965b-e5b7-4a07-8469-c2e5b7cc077d-metrics-client-ca\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.618136 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.617886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plr4w\" (UniqueName: \"kubernetes.io/projected/183f965b-e5b7-4a07-8469-c2e5b7cc077d-kube-api-access-plr4w\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.618514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.618485    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/183f965b-e5b7-4a07-8469-c2e5b7cc077d-metrics-client-ca\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.620036 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.620009    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.620463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.620437    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.620593 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.620573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.620633 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.620573    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.620670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.620659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-thanos-querier-tls\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.620702 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.620672    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/183f965b-e5b7-4a07-8469-c2e5b7cc077d-secret-grpc-tls\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.625707 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.625687    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plr4w\" (UniqueName: \"kubernetes.io/projected/183f965b-e5b7-4a07-8469-c2e5b7cc077d-kube-api-access-plr4w\") pod \"thanos-querier-6b696fcf7c-c6m67\" (UID: \"183f965b-e5b7-4a07-8469-c2e5b7cc077d\") " pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:47.717300 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.717240    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:40:47.720084 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:47.720057    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaabae0e_f30c_41f2_b6fe_fd98bc125134.slice/crio-f7260d32b2c21ebc7e71dd0c7e50aca99d094a0ad64c3e3af6a3634b1c5fcbc3 WatchSource:0}: Error finding container f7260d32b2c21ebc7e71dd0c7e50aca99d094a0ad64c3e3af6a3634b1c5fcbc3: Status 404 returned error can't find the container with id f7260d32b2c21ebc7e71dd0c7e50aca99d094a0ad64c3e3af6a3634b1c5fcbc3
Sep 12 02:40:47.744382 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:47.744361    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:48.015731 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:48.015617    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"]
Sep 12 02:40:48.017992 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:48.017967    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183f965b_e5b7_4a07_8469_c2e5b7cc077d.slice/crio-603b598d8d42ca6ef88a51f6c50b46d9baad90b7b63fe02748bd94d2d0ad4048 WatchSource:0}: Error finding container 603b598d8d42ca6ef88a51f6c50b46d9baad90b7b63fe02748bd94d2d0ad4048: Status 404 returned error can't find the container with id 603b598d8d42ca6ef88a51f6c50b46d9baad90b7b63fe02748bd94d2d0ad4048
Sep 12 02:40:48.144248 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:48.144213    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"603b598d8d42ca6ef88a51f6c50b46d9baad90b7b63fe02748bd94d2d0ad4048"}
Sep 12 02:40:48.146200 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:48.146177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h9frt" event={"ID":"601447d7-cda0-46aa-93a1-c0c55cf6dcf4","Type":"ContainerStarted","Data":"9130abfc0c054b865df77e00838b3e0a6cfcf50d6e2ab7cb090c350966b31ed6"}
Sep 12 02:40:48.146321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:48.146234    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-h9frt" event={"ID":"601447d7-cda0-46aa-93a1-c0c55cf6dcf4","Type":"ContainerStarted","Data":"fa901a3400b75a70643b073faee22033616f54834dfd757d5527482c02d18edf"}
Sep 12 02:40:48.147271 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:48.147252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"f7260d32b2c21ebc7e71dd0c7e50aca99d094a0ad64c3e3af6a3634b1c5fcbc3"}
Sep 12 02:40:48.163367 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:48.163331    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-h9frt" podStartSLOduration=2.103804957 podStartE2EDuration="3.163316946s" totalImagesPullingTime="1.000618127s" totalInitContainerRuntime="58.893862ms" isStatefulPod=true podCreationTimestamp="2026-09-12 02:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:48.162439051 +0000 UTC m=+280.418420067" watchObservedRunningTime="2026-09-12 02:40:48.163316946 +0000 UTC m=+280.419297967"
Sep 12 02:40:48.763541 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:48.763515    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dxc6w" podUID="6d05a217-bc5c-4057-bf32-595614a6310c"
Sep 12 02:40:49.152836 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:49.152802    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47" exitCode=0
Sep 12 02:40:49.153025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:49.152890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"}
Sep 12 02:40:49.153234 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:49.153214    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:40:51.165025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.164943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"0a8ced5a00a91eea8d034f664d82c300fd60f39819698258318a74288ae2dd2c"}
Sep 12 02:40:51.165443 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.165046    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"6a6418c23850c4e4f2523957443fc5a0d2296ccb5609fc0803979c7157fd0989"}
Sep 12 02:40:51.165443 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.165078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"170c125e18829b2d7dddceb48e3044a001b6c5e77a4a7ccc3ecc299f4a30a95f"}
Sep 12 02:40:51.168090 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.168066    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"}
Sep 12 02:40:51.168189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.168118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"}
Sep 12 02:40:51.168189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.168143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"}
Sep 12 02:40:51.168189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.168165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"}
Sep 12 02:40:51.168189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.168188    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"}
Sep 12 02:40:51.300195 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.300164    2583 patch_prober.go:28] interesting pod/image-registry-6bfc648fc5-xmhrr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 12 02:40:51.300322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.300211    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 02:40:51.957246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.957160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:40:51.959392 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:51.959364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d05a217-bc5c-4057-bf32-595614a6310c-metrics-tls\") pod \"dns-default-dxc6w\" (UID: \"6d05a217-bc5c-4057-bf32-595614a6310c\") " pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:40:52.156422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.156378    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4279k\""
Sep 12 02:40:52.165001 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.164970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:40:52.176299 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.176270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"83d802e1ab63eb9d4fc6d21807f167de6ea1bc51afe94c6c7f12af34c3a5c884"}
Sep 12 02:40:52.176704 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.176344    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"120e805e11f642ce1ad782e79d9e8e45aeb25c1842c7059b9ecf3c4a3a9e1da3"}
Sep 12 02:40:52.176704 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.176422    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:52.176704 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.176471    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" event={"ID":"183f965b-e5b7-4a07-8469-c2e5b7cc077d","Type":"ContainerStarted","Data":"95779bbf8ae665a4e5395827d3fa1eb681f348633108c23b43c1b86db15e0785"}
Sep 12 02:40:52.179678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.179652    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerStarted","Data":"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"}
Sep 12 02:40:52.220624 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.220570    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.026477452 podStartE2EDuration="6.220551251s" totalImagesPullingTime="3.176290119s" totalInitContainerRuntime="17.78368ms" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:52.218265211 +0000 UTC m=+284.474246246" watchObservedRunningTime="2026-09-12 02:40:52.220551251 +0000 UTC m=+284.476532267"
Sep 12 02:40:52.222229 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.222187    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67" podStartSLOduration=1.804020533 podStartE2EDuration="5.222173268s" totalImagesPullingTime="3.418152735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:52.196094802 +0000 UTC m=+284.452075821" watchObservedRunningTime="2026-09-12 02:40:52.222173268 +0000 UTC m=+284.478154283"
Sep 12 02:40:52.434433 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:52.434395    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dxc6w"]
Sep 12 02:40:52.438975 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:52.438947    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d05a217_bc5c_4057_bf32_595614a6310c.slice/crio-204d967b2ed5927fb6cc2d082b71d580cef85eae98cc1c9fa6062521fa9395ed WatchSource:0}: Error finding container 204d967b2ed5927fb6cc2d082b71d580cef85eae98cc1c9fa6062521fa9395ed: Status 404 returned error can't find the container with id 204d967b2ed5927fb6cc2d082b71d580cef85eae98cc1c9fa6062521fa9395ed
Sep 12 02:40:53.184966 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:53.184922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxc6w" event={"ID":"6d05a217-bc5c-4057-bf32-595614a6310c","Type":"ContainerStarted","Data":"204d967b2ed5927fb6cc2d082b71d580cef85eae98cc1c9fa6062521fa9395ed"}
Sep 12 02:40:54.192238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:54.192207    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxc6w" event={"ID":"6d05a217-bc5c-4057-bf32-595614a6310c","Type":"ContainerStarted","Data":"93ba575ff626716490d599ced9df0d2289034fca90b994eee9c14fa73755f58b"}
Sep 12 02:40:55.197685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:55.197644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dxc6w" event={"ID":"6d05a217-bc5c-4057-bf32-595614a6310c","Type":"ContainerStarted","Data":"b94e3c32fcf1f0f06119715b6c20f7817ee6becf354395c11e88b5d3c36a3168"}
Sep 12 02:40:55.198098 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:55.197752    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:40:55.213874 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:55.213830    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dxc6w" podStartSLOduration=251.602969447 podStartE2EDuration="4m13.213817693s" totalImagesPullingTime="1.610848246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:36:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:55.212951158 +0000 UTC m=+287.468932173" watchObservedRunningTime="2026-09-12 02:40:55.213817693 +0000 UTC m=+287.469798707"
Sep 12 02:40:56.313245 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.313188    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerName="registry" containerID="cri-o://95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3" gracePeriod=30
Sep 12 02:40:56.564231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.564212    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:56.597614 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597586    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-installation-pull-secrets\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.597761 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597629    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cvph\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-kube-api-access-9cvph\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.597761 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597656    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-trusted-ca\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.597761 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5761086-b3f2-4b2e-92c9-26462fdd9c31-ca-trust-extracted\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.597923 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597823    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-image-registry-private-configuration\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.597923 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597878    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.597923 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597908    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-certificates\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.598078 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.597969    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-bound-sa-token\") pod \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\" (UID: \"e5761086-b3f2-4b2e-92c9-26462fdd9c31\") "
Sep 12 02:40:56.598732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.598200    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:40:56.598732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.598687    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:40:56.601957 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.601910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:40:56.602608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.602560    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-kube-api-access-9cvph" (OuterVolumeSpecName: "kube-api-access-9cvph") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "kube-api-access-9cvph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:40:56.602729 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.602632    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:40:56.602960 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.602930    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:40:56.604132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.604071    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:40:56.610873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.610853    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5761086-b3f2-4b2e-92c9-26462fdd9c31-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e5761086-b3f2-4b2e-92c9-26462fdd9c31" (UID: "e5761086-b3f2-4b2e-92c9-26462fdd9c31"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:40:56.699150 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699110    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-installation-pull-secrets\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699150 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699151    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cvph\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-kube-api-access-9cvph\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699167    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-trusted-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699180    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5761086-b3f2-4b2e-92c9-26462fdd9c31-ca-trust-extracted\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699195    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5761086-b3f2-4b2e-92c9-26462fdd9c31-image-registry-private-configuration\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699209    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-tls\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699222    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5761086-b3f2-4b2e-92c9-26462fdd9c31-registry-certificates\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:56.699315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:56.699235    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5761086-b3f2-4b2e-92c9-26462fdd9c31-bound-sa-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:40:57.206870 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.206839    2583 generic.go:356] "Generic (PLEG): container finished" podID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerID="95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3" exitCode=0
Sep 12 02:40:57.207032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.206881    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr"
Sep 12 02:40:57.207032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.206904    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" event={"ID":"e5761086-b3f2-4b2e-92c9-26462fdd9c31","Type":"ContainerDied","Data":"95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3"}
Sep 12 02:40:57.207032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.206940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bfc648fc5-xmhrr" event={"ID":"e5761086-b3f2-4b2e-92c9-26462fdd9c31","Type":"ContainerDied","Data":"a273e85d0665856d3b5e822069fa1df15de5fb04642d7bc1321b765c40bcf596"}
Sep 12 02:40:57.207032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.206958    2583 scope.go:117] "RemoveContainer" containerID="95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3"
Sep 12 02:40:57.215037 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.215019    2583 scope.go:117] "RemoveContainer" containerID="95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3"
Sep 12 02:40:57.215299 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:40:57.215280    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3\": container with ID starting with 95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3 not found: ID does not exist" containerID="95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3"
Sep 12 02:40:57.215339 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.215306    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3"} err="failed to get container status \"95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3\": rpc error: code = NotFound desc = could not find container \"95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3\": container with ID starting with 95c481f4bf0fe00248b4dcfd315abedf7b649eaa04840d54e87277b3664fdfd3 not found: ID does not exist"
Sep 12 02:40:57.226541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.226523    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bfc648fc5-xmhrr"]
Sep 12 02:40:57.231752 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:57.231734    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bfc648fc5-xmhrr"]
Sep 12 02:40:58.157262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:58.157234    2583 scope.go:117] "RemoveContainer" containerID="19914a37fd79d6eb107271aeefe6262400af165d4fd2b21bc80cc1c595a497ea"
Sep 12 02:40:58.160285 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:58.160261    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" path="/var/lib/kubelet/pods/e5761086-b3f2-4b2e-92c9-26462fdd9c31/volumes"
Sep 12 02:40:58.191302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:58.191283    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b696fcf7c-c6m67"
Sep 12 02:40:59.218369 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.218343    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:40:59.218765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.218395    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-r444n" event={"ID":"75c9e2fc-13ee-45c0-824e-396644cb5fff","Type":"ContainerStarted","Data":"85bb7d65de0c82f9896c7ae40d89d029257140aa6219f293a09fdc9becdbad3d"}
Sep 12 02:40:59.218765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.218697    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:59.223358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.223331    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-r444n"
Sep 12 02:40:59.236758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.236713    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-r444n" podStartSLOduration=54.21724328 podStartE2EDuration="56.236699781s" totalImagesPullingTime="2.019456501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:40:59.235641584 +0000 UTC m=+291.491622603" watchObservedRunningTime="2026-09-12 02:40:59.236699781 +0000 UTC m=+291.492680817"
Sep 12 02:40:59.388503 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.388469    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-c45fd"]
Sep 12 02:40:59.388793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.388780    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerName="registry"
Sep 12 02:40:59.388833 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.388795    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerName="registry"
Sep 12 02:40:59.388863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.388851    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5761086-b3f2-4b2e-92c9-26462fdd9c31" containerName="registry"
Sep 12 02:40:59.392154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.392134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:40:59.394528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.394504    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 12 02:40:59.394528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.394519    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kqkvb\""
Sep 12 02:40:59.394684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.394570    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 12 02:40:59.401437 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.401419    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-c45fd"]
Sep 12 02:40:59.520107 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.520035    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhjtr\" (UniqueName: \"kubernetes.io/projected/6f644ba7-a0c9-4f6b-a2a9-0a818116ac24-kube-api-access-qhjtr\") pod \"downloads-76f99584f4-c45fd\" (UID: \"6f644ba7-a0c9-4f6b-a2a9-0a818116ac24\") " pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:40:59.621162 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.621120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhjtr\" (UniqueName: \"kubernetes.io/projected/6f644ba7-a0c9-4f6b-a2a9-0a818116ac24-kube-api-access-qhjtr\") pod \"downloads-76f99584f4-c45fd\" (UID: \"6f644ba7-a0c9-4f6b-a2a9-0a818116ac24\") " pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:40:59.630304 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.630281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhjtr\" (UniqueName: \"kubernetes.io/projected/6f644ba7-a0c9-4f6b-a2a9-0a818116ac24-kube-api-access-qhjtr\") pod \"downloads-76f99584f4-c45fd\" (UID: \"6f644ba7-a0c9-4f6b-a2a9-0a818116ac24\") " pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:40:59.702028 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.701997    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:40:59.969876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:40:59.969853    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-c45fd"]
Sep 12 02:40:59.974976 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:40:59.972632    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f644ba7_a0c9_4f6b_a2a9_0a818116ac24.slice/crio-c47b869596281f6d5912c38e91882fd31e9db02b59913640fcde53a2a50ebd91 WatchSource:0}: Error finding container c47b869596281f6d5912c38e91882fd31e9db02b59913640fcde53a2a50ebd91: Status 404 returned error can't find the container with id c47b869596281f6d5912c38e91882fd31e9db02b59913640fcde53a2a50ebd91
Sep 12 02:41:00.223753 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:00.223674    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-c45fd" event={"ID":"6f644ba7-a0c9-4f6b-a2a9-0a818116ac24","Type":"ContainerStarted","Data":"c47b869596281f6d5912c38e91882fd31e9db02b59913640fcde53a2a50ebd91"}
Sep 12 02:41:04.155162 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:41:04.155117    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vt47l" podUID="79a51ccb-246e-44da-9d05-ec1c2a395d1a"
Sep 12 02:41:05.204566 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:05.204531    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dxc6w"
Sep 12 02:41:08.105122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:08.105097    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:41:08.106784 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:08.106762    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:41:08.113593 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:08.113470    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:41:08.113876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:08.113730    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:41:08.122632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:08.122613    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 12 02:41:10.468511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.468477    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7989bc56b8-lkl8f"]
Sep 12 02:41:10.473571 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.473517    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.476212 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.476028    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 12 02:41:10.477036 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.477011    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 12 02:41:10.477165 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.477053    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jg567\""
Sep 12 02:41:10.477165 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.477090    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 12 02:41:10.477165 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.477094    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 12 02:41:10.477562 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.477545    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 12 02:41:10.482763 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.482739    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7989bc56b8-lkl8f"]
Sep 12 02:41:10.617197 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.617160    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-oauth-config\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.617389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.617240    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-oauth-serving-cert\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.617389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.617307    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hpmf\" (UniqueName: \"kubernetes.io/projected/d6b3e797-b852-4c0f-aff8-2d825bde6df2-kube-api-access-5hpmf\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.617546 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.617427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-service-ca\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.617546 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.617470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-config\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.617641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.617550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-serving-cert\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.718670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.718581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-serving-cert\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.718670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.718641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-oauth-config\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.718896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.718705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-oauth-serving-cert\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.718896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.718732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hpmf\" (UniqueName: \"kubernetes.io/projected/d6b3e797-b852-4c0f-aff8-2d825bde6df2-kube-api-access-5hpmf\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.718896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.718782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-service-ca\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.718896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.718814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-config\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.719565 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.719539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-config\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.719681 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.719539    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-oauth-serving-cert\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.719681 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.719641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-service-ca\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.721951 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.721924    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-oauth-config\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.722154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.722133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-serving-cert\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.726900 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.726879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hpmf\" (UniqueName: \"kubernetes.io/projected/d6b3e797-b852-4c0f-aff8-2d825bde6df2-kube-api-access-5hpmf\") pod \"console-7989bc56b8-lkl8f\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") " pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:10.785917 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:10.785878    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:15.774514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:15.774485    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7989bc56b8-lkl8f"]
Sep 12 02:41:15.776854 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:41:15.776808    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b3e797_b852_4c0f_aff8_2d825bde6df2.slice/crio-4817772251f23068efd3e1c5ce91860ae0dc29c0fea16bb5b0e767338abd6ac5 WatchSource:0}: Error finding container 4817772251f23068efd3e1c5ce91860ae0dc29c0fea16bb5b0e767338abd6ac5: Status 404 returned error can't find the container with id 4817772251f23068efd3e1c5ce91860ae0dc29c0fea16bb5b0e767338abd6ac5
Sep 12 02:41:15.779230 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:15.779197    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 02:41:16.297708 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:16.297665    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989bc56b8-lkl8f" event={"ID":"d6b3e797-b852-4c0f-aff8-2d825bde6df2","Type":"ContainerStarted","Data":"4817772251f23068efd3e1c5ce91860ae0dc29c0fea16bb5b0e767338abd6ac5"}
Sep 12 02:41:16.299579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:16.299543    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-c45fd" event={"ID":"6f644ba7-a0c9-4f6b-a2a9-0a818116ac24","Type":"ContainerStarted","Data":"2b749f2b238f74ba5dbce12aa129342200e26a71942bc7837c110a6fde00f6cf"}
Sep 12 02:41:16.299809 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:16.299782    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:41:16.314819 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:16.314787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-c45fd"
Sep 12 02:41:16.317383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:16.317331    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-c45fd" podStartSLOduration=1.6896033400000001 podStartE2EDuration="17.317314811s" totalImagesPullingTime="15.627711471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:40:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:41:16.315770316 +0000 UTC m=+308.571751332" watchObservedRunningTime="2026-09-12 02:41:16.317314811 +0000 UTC m=+308.573295849"
Sep 12 02:41:19.154859 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.154821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:41:19.693838 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.693802    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8fcb44f84-g4pcx"]
Sep 12 02:41:19.715558 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.715528    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8fcb44f84-g4pcx"]
Sep 12 02:41:19.715726 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.715654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.723505 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.723386    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 12 02:41:19.812154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-serving-cert\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.812154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjspv\" (UniqueName: \"kubernetes.io/projected/97165d84-ae86-4811-bfe0-09aba82a924a-kube-api-access-hjspv\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.812355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812211    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-oauth-config\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.812355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-oauth-serving-cert\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.812355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812300    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-service-ca\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.812355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-console-config\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.812554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.812419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-trusted-ca-bundle\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.913830 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.913790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-oauth-config\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.913845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-oauth-serving-cert\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.913902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-service-ca\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.913937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-console-config\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.913979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-trusted-ca-bundle\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.914021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-serving-cert\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.914178    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjspv\" (UniqueName: \"kubernetes.io/projected/97165d84-ae86-4811-bfe0-09aba82a924a-kube-api-access-hjspv\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.914829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-console-config\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.914838    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-oauth-serving-cert\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.914956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.914927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-service-ca\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.915262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.915010    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-trusted-ca-bundle\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.916787 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.916764    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-oauth-config\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.916787 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.916778    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-serving-cert\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:19.921621 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:19.921596    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjspv\" (UniqueName: \"kubernetes.io/projected/97165d84-ae86-4811-bfe0-09aba82a924a-kube-api-access-hjspv\") pod \"console-8fcb44f84-g4pcx\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") " pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:20.027615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.027578    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:20.320789 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.320706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989bc56b8-lkl8f" event={"ID":"d6b3e797-b852-4c0f-aff8-2d825bde6df2","Type":"ContainerStarted","Data":"a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f"}
Sep 12 02:41:20.337881 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.337832    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7989bc56b8-lkl8f" podStartSLOduration=6.611690714 podStartE2EDuration="10.337815367s" totalImagesPullingTime="3.726124653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:41:20.3357394 +0000 UTC m=+312.591720426" watchObservedRunningTime="2026-09-12 02:41:20.337815367 +0000 UTC m=+312.593796379"
Sep 12 02:41:20.360683 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.360654    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8fcb44f84-g4pcx"]
Sep 12 02:41:20.363349 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:41:20.363318    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97165d84_ae86_4811_bfe0_09aba82a924a.slice/crio-77753e717bd036f7bdeb640ced045ca1594c64d82acf00291536f49a2eb78976 WatchSource:0}: Error finding container 77753e717bd036f7bdeb640ced045ca1594c64d82acf00291536f49a2eb78976: Status 404 returned error can't find the container with id 77753e717bd036f7bdeb640ced045ca1594c64d82acf00291536f49a2eb78976
Sep 12 02:41:20.786187 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.786102    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:20.786346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.786207    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:20.791456 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:20.791428    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:21.327422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:21.327368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcb44f84-g4pcx" event={"ID":"97165d84-ae86-4811-bfe0-09aba82a924a","Type":"ContainerStarted","Data":"988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c"}
Sep 12 02:41:21.327859 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:21.327437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcb44f84-g4pcx" event={"ID":"97165d84-ae86-4811-bfe0-09aba82a924a","Type":"ContainerStarted","Data":"77753e717bd036f7bdeb640ced045ca1594c64d82acf00291536f49a2eb78976"}
Sep 12 02:41:21.331789 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:21.331762    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:21.345003 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:21.344962    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8fcb44f84-g4pcx" podStartSLOduration=2.34494782 podStartE2EDuration="2.34494782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:41:21.344429589 +0000 UTC m=+313.600410604" watchObservedRunningTime="2026-09-12 02:41:21.34494782 +0000 UTC m=+313.600928892"
Sep 12 02:41:30.028014 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:30.027980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:30.028479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:30.028070    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:30.032587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:30.032565    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:30.368652 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:30.368624    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:41:30.411143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:30.411118    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7989bc56b8-lkl8f"]
Sep 12 02:41:55.436522 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.436468    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7989bc56b8-lkl8f" podUID="d6b3e797-b852-4c0f-aff8-2d825bde6df2" containerName="console" containerID="cri-o://a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f" gracePeriod=15
Sep 12 02:41:55.697860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.697795    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:55.807590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807562    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-serving-cert\") pod \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") "
Sep 12 02:41:55.807590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807592    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-oauth-serving-cert\") pod \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") "
Sep 12 02:41:55.807788 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807616    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-oauth-config\") pod \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") "
Sep 12 02:41:55.807788 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807637    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hpmf\" (UniqueName: \"kubernetes.io/projected/d6b3e797-b852-4c0f-aff8-2d825bde6df2-kube-api-access-5hpmf\") pod \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") "
Sep 12 02:41:55.807788 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807659    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-service-ca\") pod \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") "
Sep 12 02:41:55.807788 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807780    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-config\") pod \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\" (UID: \"d6b3e797-b852-4c0f-aff8-2d825bde6df2\") "
Sep 12 02:41:55.808005 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d6b3e797-b852-4c0f-aff8-2d825bde6df2" (UID: "d6b3e797-b852-4c0f-aff8-2d825bde6df2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:41:55.808005 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.807989    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-service-ca" (OuterVolumeSpecName: "service-ca") pod "d6b3e797-b852-4c0f-aff8-2d825bde6df2" (UID: "d6b3e797-b852-4c0f-aff8-2d825bde6df2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:41:55.808113 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.808082    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:41:55.808113 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.808100    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:41:55.808325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.808299    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-config" (OuterVolumeSpecName: "console-config") pod "d6b3e797-b852-4c0f-aff8-2d825bde6df2" (UID: "d6b3e797-b852-4c0f-aff8-2d825bde6df2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:41:55.814888 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.814861    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d6b3e797-b852-4c0f-aff8-2d825bde6df2" (UID: "d6b3e797-b852-4c0f-aff8-2d825bde6df2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:41:55.815062 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.815033    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d6b3e797-b852-4c0f-aff8-2d825bde6df2" (UID: "d6b3e797-b852-4c0f-aff8-2d825bde6df2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:41:55.815167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.815083    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b3e797-b852-4c0f-aff8-2d825bde6df2-kube-api-access-5hpmf" (OuterVolumeSpecName: "kube-api-access-5hpmf") pod "d6b3e797-b852-4c0f-aff8-2d825bde6df2" (UID: "d6b3e797-b852-4c0f-aff8-2d825bde6df2"). InnerVolumeSpecName "kube-api-access-5hpmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:41:55.909453 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.909429    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:41:55.909453 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.909449    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:41:55.909579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.909458    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hpmf\" (UniqueName: \"kubernetes.io/projected/d6b3e797-b852-4c0f-aff8-2d825bde6df2-kube-api-access-5hpmf\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:41:55.909579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:55.909467    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d6b3e797-b852-4c0f-aff8-2d825bde6df2-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:41:56.464354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.464284    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6b3e797-b852-4c0f-aff8-2d825bde6df2" containerID="a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f" exitCode=0
Sep 12 02:41:56.464354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.464345    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989bc56b8-lkl8f"
Sep 12 02:41:56.464848 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.464375    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989bc56b8-lkl8f" event={"ID":"d6b3e797-b852-4c0f-aff8-2d825bde6df2","Type":"ContainerDied","Data":"a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f"}
Sep 12 02:41:56.464848 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.464449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989bc56b8-lkl8f" event={"ID":"d6b3e797-b852-4c0f-aff8-2d825bde6df2","Type":"ContainerDied","Data":"4817772251f23068efd3e1c5ce91860ae0dc29c0fea16bb5b0e767338abd6ac5"}
Sep 12 02:41:56.464848 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.464480    2583 scope.go:117] "RemoveContainer" containerID="a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f"
Sep 12 02:41:56.471978 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.471962    2583 scope.go:117] "RemoveContainer" containerID="a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f"
Sep 12 02:41:56.472297 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:41:56.472275    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f\": container with ID starting with a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f not found: ID does not exist" containerID="a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f"
Sep 12 02:41:56.472384 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.472303    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f"} err="failed to get container status \"a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f\": rpc error: code = NotFound desc = could not find container \"a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f\": container with ID starting with a9b84112c31cae85da56a01b2d7291c928d6bf340de7334043ac89ef93354f6f not found: ID does not exist"
Sep 12 02:41:56.481419 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.481387    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7989bc56b8-lkl8f"]
Sep 12 02:41:56.484497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:56.484477    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7989bc56b8-lkl8f"]
Sep 12 02:41:58.159511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:41:58.159481    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b3e797-b852-4c0f-aff8-2d825bde6df2" path="/var/lib/kubelet/pods/d6b3e797-b852-4c0f-aff8-2d825bde6df2/volumes"
Sep 12 02:42:05.740085 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740004    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:42:05.740587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740312    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="alertmanager" containerID="cri-o://74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03" gracePeriod=120
Sep 12 02:42:05.740587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740385    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-metric" containerID="cri-o://ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0" gracePeriod=120
Sep 12 02:42:05.740587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740454    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="prom-label-proxy" containerID="cri-o://a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48" gracePeriod=120
Sep 12 02:42:05.740587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740484    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="config-reloader" containerID="cri-o://93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d" gracePeriod=120
Sep 12 02:42:05.740587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740487    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy" containerID="cri-o://62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918" gracePeriod=120
Sep 12 02:42:05.740587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:05.740439    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-web" containerID="cri-o://a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428" gracePeriod=120
Sep 12 02:42:06.507732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507695    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48" exitCode=0
Sep 12 02:42:06.507732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507725    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918" exitCode=0
Sep 12 02:42:06.507732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507732    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d" exitCode=0
Sep 12 02:42:06.507732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507737    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03" exitCode=0
Sep 12 02:42:06.507992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507771    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"}
Sep 12 02:42:06.507992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507843    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"}
Sep 12 02:42:06.507992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507872    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"}
Sep 12 02:42:06.507992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.507898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"}
Sep 12 02:42:06.994817 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:06.994791    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.099935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.099841    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-trusted-ca-bundle\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.099935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.099881    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-cluster-tls-config\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.099937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-web\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.099978    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100015    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-volume\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100041    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-tls-assets\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-out\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100125    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-metric\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100154    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-web-config\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100179    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-main-db\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rd4h9\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-kube-api-access-rd4h9\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100235    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100260    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-metrics-client-ca\") pod \"caabae0e-f30c-41f2-b6fe-fd98bc125134\" (UID: \"caabae0e-f30c-41f2-b6fe-fd98bc125134\") "
Sep 12 02:42:07.100507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100260    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:42:07.100757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100548    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.100930 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.100885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:42:07.101142 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.101116    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:42:07.102777 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.102746    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.103386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.103101    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-volume" (OuterVolumeSpecName: "config-volume") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.103386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.103288    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.103386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.103320    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-out" (OuterVolumeSpecName: "config-out") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:42:07.103773 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.103745    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-kube-api-access-rd4h9" (OuterVolumeSpecName: "kube-api-access-rd4h9") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "kube-api-access-rd4h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:42:07.104174 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.104145    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:42:07.104861 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.104834    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.105297 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.105268    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.107428 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.107304    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.113113 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.113088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-web-config" (OuterVolumeSpecName: "web-config") pod "caabae0e-f30c-41f2-b6fe-fd98bc125134" (UID: "caabae0e-f30c-41f2-b6fe-fd98bc125134"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:07.200945 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200905    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.200945 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200938    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-web-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.200945 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200949    2583 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-alertmanager-main-db\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200960    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rd4h9\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-kube-api-access-rd4h9\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200969    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-main-tls\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200977    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caabae0e-f30c-41f2-b6fe-fd98bc125134-metrics-client-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200985    2583 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-cluster-tls-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.200993    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.201002    2583 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.201011    2583 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.201019    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caabae0e-f30c-41f2-b6fe-fd98bc125134-tls-assets\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.201184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.201026    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caabae0e-f30c-41f2-b6fe-fd98bc125134-config-out\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:07.515261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515171    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0" exitCode=0
Sep 12 02:42:07.515261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515197    2583 generic.go:356] "Generic (PLEG): container finished" podID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerID="a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428" exitCode=0
Sep 12 02:42:07.515261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515254    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.515500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"}
Sep 12 02:42:07.515500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515393    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"}
Sep 12 02:42:07.515500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515429    2583 scope.go:117] "RemoveContainer" containerID="a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"
Sep 12 02:42:07.515500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.515438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caabae0e-f30c-41f2-b6fe-fd98bc125134","Type":"ContainerDied","Data":"f7260d32b2c21ebc7e71dd0c7e50aca99d094a0ad64c3e3af6a3634b1c5fcbc3"}
Sep 12 02:42:07.524371 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.524353    2583 scope.go:117] "RemoveContainer" containerID="ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"
Sep 12 02:42:07.532037 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.532017    2583 scope.go:117] "RemoveContainer" containerID="62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"
Sep 12 02:42:07.538577 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.538561    2583 scope.go:117] "RemoveContainer" containerID="a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"
Sep 12 02:42:07.540616 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.540596    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:42:07.545157 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.545137    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:42:07.546236 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.546216    2583 scope.go:117] "RemoveContainer" containerID="93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"
Sep 12 02:42:07.553078 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.553062    2583 scope.go:117] "RemoveContainer" containerID="74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"
Sep 12 02:42:07.559805 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.559785    2583 scope.go:117] "RemoveContainer" containerID="bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"
Sep 12 02:42:07.566391 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.566373    2583 scope.go:117] "RemoveContainer" containerID="a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"
Sep 12 02:42:07.566672 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.566646    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48\": container with ID starting with a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48 not found: ID does not exist" containerID="a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"
Sep 12 02:42:07.566715 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.566682    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"} err="failed to get container status \"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48\": rpc error: code = NotFound desc = could not find container \"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48\": container with ID starting with a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48 not found: ID does not exist"
Sep 12 02:42:07.566715 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.566701    2583 scope.go:117] "RemoveContainer" containerID="ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"
Sep 12 02:42:07.566947 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.566930    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0\": container with ID starting with ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0 not found: ID does not exist" containerID="ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"
Sep 12 02:42:07.566984 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.566954    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"} err="failed to get container status \"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0\": rpc error: code = NotFound desc = could not find container \"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0\": container with ID starting with ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0 not found: ID does not exist"
Sep 12 02:42:07.566984 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.566971    2583 scope.go:117] "RemoveContainer" containerID="62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"
Sep 12 02:42:07.567209 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.567195    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918\": container with ID starting with 62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918 not found: ID does not exist" containerID="62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"
Sep 12 02:42:07.567243 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567213    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"} err="failed to get container status \"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918\": rpc error: code = NotFound desc = could not find container \"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918\": container with ID starting with 62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918 not found: ID does not exist"
Sep 12 02:42:07.567243 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567226    2583 scope.go:117] "RemoveContainer" containerID="a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"
Sep 12 02:42:07.567463 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.567445    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428\": container with ID starting with a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428 not found: ID does not exist" containerID="a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"
Sep 12 02:42:07.567505 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567468    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"} err="failed to get container status \"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428\": rpc error: code = NotFound desc = could not find container \"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428\": container with ID starting with a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428 not found: ID does not exist"
Sep 12 02:42:07.567505 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567482    2583 scope.go:117] "RemoveContainer" containerID="93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"
Sep 12 02:42:07.567709 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.567694    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d\": container with ID starting with 93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d not found: ID does not exist" containerID="93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"
Sep 12 02:42:07.567744 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567714    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"} err="failed to get container status \"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d\": rpc error: code = NotFound desc = could not find container \"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d\": container with ID starting with 93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d not found: ID does not exist"
Sep 12 02:42:07.567744 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567727    2583 scope.go:117] "RemoveContainer" containerID="74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"
Sep 12 02:42:07.567938 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.567924    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03\": container with ID starting with 74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03 not found: ID does not exist" containerID="74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"
Sep 12 02:42:07.567972 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567940    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"} err="failed to get container status \"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03\": rpc error: code = NotFound desc = could not find container \"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03\": container with ID starting with 74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03 not found: ID does not exist"
Sep 12 02:42:07.567972 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.567962    2583 scope.go:117] "RemoveContainer" containerID="bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"
Sep 12 02:42:07.568172 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:07.568155    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47\": container with ID starting with bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47 not found: ID does not exist" containerID="bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"
Sep 12 02:42:07.568249 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568177    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"} err="failed to get container status \"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47\": rpc error: code = NotFound desc = could not find container \"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47\": container with ID starting with bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47 not found: ID does not exist"
Sep 12 02:42:07.568249 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568199    2583 scope.go:117] "RemoveContainer" containerID="a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"
Sep 12 02:42:07.568429 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568398    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48"} err="failed to get container status \"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48\": rpc error: code = NotFound desc = could not find container \"a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48\": container with ID starting with a2fa25b5414a09e73c46b28c2480f29b35b7802fb2edb210402ce0ad8b6f0d48 not found: ID does not exist"
Sep 12 02:42:07.568480 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568430    2583 scope.go:117] "RemoveContainer" containerID="ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"
Sep 12 02:42:07.568697 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568673    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0"} err="failed to get container status \"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0\": rpc error: code = NotFound desc = could not find container \"ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0\": container with ID starting with ff0456159e29a456e384bb3d02296e0133ccd932e78e330aa88b6c7f33a202a0 not found: ID does not exist"
Sep 12 02:42:07.568697 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568699    2583 scope.go:117] "RemoveContainer" containerID="62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"
Sep 12 02:42:07.568950 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568924    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918"} err="failed to get container status \"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918\": rpc error: code = NotFound desc = could not find container \"62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918\": container with ID starting with 62b0cbf7a1655e33f85dc9a5ba9ceb377a607f138e4397020ca2f487838d3918 not found: ID does not exist"
Sep 12 02:42:07.569047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.568963    2583 scope.go:117] "RemoveContainer" containerID="a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"
Sep 12 02:42:07.569369 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.569231    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428"} err="failed to get container status \"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428\": rpc error: code = NotFound desc = could not find container \"a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428\": container with ID starting with a5af0d5ba18a4c12bff833686bdd918c2c7807c23f900bc13318780e6cfaa428 not found: ID does not exist"
Sep 12 02:42:07.569470 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.569372    2583 scope.go:117] "RemoveContainer" containerID="93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"
Sep 12 02:42:07.569675 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.569654    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d"} err="failed to get container status \"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d\": rpc error: code = NotFound desc = could not find container \"93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d\": container with ID starting with 93684b15f94984b12693f2afb640087de014ac8a2b6d95d5f078f2dd1769768d not found: ID does not exist"
Sep 12 02:42:07.569775 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.569685    2583 scope.go:117] "RemoveContainer" containerID="74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"
Sep 12 02:42:07.569977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.569958    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03"} err="failed to get container status \"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03\": rpc error: code = NotFound desc = could not find container \"74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03\": container with ID starting with 74c9d871eeb7ff3da3c8d04431c457a8e1a4da3ea2d51135aae649e4147d6b03 not found: ID does not exist"
Sep 12 02:42:07.570046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.569978    2583 scope.go:117] "RemoveContainer" containerID="bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"
Sep 12 02:42:07.570224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.570206    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47"} err="failed to get container status \"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47\": rpc error: code = NotFound desc = could not find container \"bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47\": container with ID starting with bbc45455499d37c6e5a0d93a6ec96e9cf9e7effeb8d5e689ccb2aab6db742a47 not found: ID does not exist"
Sep 12 02:42:07.570755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.570737    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:42:07.571039 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571010    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-web"
Sep 12 02:42:07.571039 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571034    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-web"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571043    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-metric"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571049    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-metric"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571058    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="init-config-reloader"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571063    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="init-config-reloader"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571072    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b3e797-b852-4c0f-aff8-2d825bde6df2" containerName="console"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571077    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b3e797-b852-4c0f-aff8-2d825bde6df2" containerName="console"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571084    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571089    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571096    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="prom-label-proxy"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571101    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="prom-label-proxy"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571108    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="alertmanager"
Sep 12 02:42:07.571109 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571113    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="alertmanager"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571120    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="config-reloader"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571125    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="config-reloader"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571178    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="alertmanager"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571185    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571191    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-metric"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571196    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="kube-rbac-proxy-web"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571202    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="config-reloader"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571208    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" containerName="prom-label-proxy"
Sep 12 02:42:07.571502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.571213    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b3e797-b852-4c0f-aff8-2d825bde6df2" containerName="console"
Sep 12 02:42:07.574730 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.574716    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.577645 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.577624    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 12 02:42:07.577741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.577712    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 12 02:42:07.578276 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.578261    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 12 02:42:07.578364 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.578284    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 12 02:42:07.578491 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.578475    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 12 02:42:07.578703 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.578686    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h4g6k\""
Sep 12 02:42:07.578773 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.578757    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 12 02:42:07.579017 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.579000    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 12 02:42:07.579097 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.579026    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 12 02:42:07.585207 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.585188    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 12 02:42:07.623277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.623125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:42:07.704066 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-web-config\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704066 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704067    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704110    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119899e1-f068-4f6e-81ba-33eb97ab9c8d-config-out\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704128    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119899e1-f068-4f6e-81ba-33eb97ab9c8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx96k\" (UniqueName: \"kubernetes.io/projected/119899e1-f068-4f6e-81ba-33eb97ab9c8d-kube-api-access-wx96k\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119899e1-f068-4f6e-81ba-33eb97ab9c8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/119899e1-f068-4f6e-81ba-33eb97ab9c8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704498 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119899e1-f068-4f6e-81ba-33eb97ab9c8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704498 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704498 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704498 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.704498 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.704432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805510    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119899e1-f068-4f6e-81ba-33eb97ab9c8d-config-out\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805592    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119899e1-f068-4f6e-81ba-33eb97ab9c8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx96k\" (UniqueName: \"kubernetes.io/projected/119899e1-f068-4f6e-81ba-33eb97ab9c8d-kube-api-access-wx96k\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119899e1-f068-4f6e-81ba-33eb97ab9c8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/119899e1-f068-4f6e-81ba-33eb97ab9c8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119899e1-f068-4f6e-81ba-33eb97ab9c8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.805897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805871    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-web-config\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.806332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.805903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.806332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.806112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/119899e1-f068-4f6e-81ba-33eb97ab9c8d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.807104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.806751    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/119899e1-f068-4f6e-81ba-33eb97ab9c8d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.807104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.806771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/119899e1-f068-4f6e-81ba-33eb97ab9c8d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.808592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.808473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/119899e1-f068-4f6e-81ba-33eb97ab9c8d-config-out\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809021 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.808809    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/119899e1-f068-4f6e-81ba-33eb97ab9c8d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809021 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.808951    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809021 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.808952    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-config-volume\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809226 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.809032    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809226 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.809128    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809226 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.809218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.809913 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.809889    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-web-config\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.810595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.810575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/119899e1-f068-4f6e-81ba-33eb97ab9c8d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.813978 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.813960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx96k\" (UniqueName: \"kubernetes.io/projected/119899e1-f068-4f6e-81ba-33eb97ab9c8d-kube-api-access-wx96k\") pod \"alertmanager-main-0\" (UID: \"119899e1-f068-4f6e-81ba-33eb97ab9c8d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:07.884893 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:07.884861    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 12 02:42:08.160444 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:08.159672    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caabae0e-f30c-41f2-b6fe-fd98bc125134" path="/var/lib/kubelet/pods/caabae0e-f30c-41f2-b6fe-fd98bc125134/volumes"
Sep 12 02:42:08.161639 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:08.161612    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 12 02:42:08.164933 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:42:08.164898    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119899e1_f068_4f6e_81ba_33eb97ab9c8d.slice/crio-ed94a7b5250429a6c3851f4851a57bf8df489f66adb76587d1ed2bc3c17a9e00 WatchSource:0}: Error finding container ed94a7b5250429a6c3851f4851a57bf8df489f66adb76587d1ed2bc3c17a9e00: Status 404 returned error can't find the container with id ed94a7b5250429a6c3851f4851a57bf8df489f66adb76587d1ed2bc3c17a9e00
Sep 12 02:42:08.520104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:08.520016    2583 generic.go:356] "Generic (PLEG): container finished" podID="119899e1-f068-4f6e-81ba-33eb97ab9c8d" containerID="36350c6c690cb950b1ebb1b2d8669f82c04af26d13bccf14ce871bc301e5ce7e" exitCode=0
Sep 12 02:42:08.520104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:08.520060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerDied","Data":"36350c6c690cb950b1ebb1b2d8669f82c04af26d13bccf14ce871bc301e5ce7e"}
Sep 12 02:42:08.520307 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:08.520186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"ed94a7b5250429a6c3851f4851a57bf8df489f66adb76587d1ed2bc3c17a9e00"}
Sep 12 02:42:09.527281 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.527238    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"decb0ba89a40673c64f1fbbdd86d420bd6ef66f33d7e742a07477fc1f5dd45f6"}
Sep 12 02:42:09.527765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.527325    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"07bb553e56aa60c730e3ba6527170d6368b2bd99d7c90d11d4c1615618f29469"}
Sep 12 02:42:09.527765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.527373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"c0f0eb4a762e59a4ce4db2467985480f8cf76e1efd08fbe346b4e6ca84c00bb8"}
Sep 12 02:42:09.527765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.527430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"237e3ab1811a8cca1512b98e6f9adde9c052b7386b0733c4678b157c3b007896"}
Sep 12 02:42:09.527765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.527479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"279008cb1291a878e62740020038fce16a2a9480082e73c36cef776b3dc2bc88"}
Sep 12 02:42:09.527765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.527517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"119899e1-f068-4f6e-81ba-33eb97ab9c8d","Type":"ContainerStarted","Data":"ed7643dd7d439f9d30e468c0cd634e0e8dcb3f268c7f1f382585d30bea07185d"}
Sep 12 02:42:09.552510 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.552458    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.536542684 podStartE2EDuration="2.552439578s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.896894ms" isStatefulPod=false podCreationTimestamp="2026-09-12 02:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:42:09.550823832 +0000 UTC m=+361.806804847" watchObservedRunningTime="2026-09-12 02:42:09.552439578 +0000 UTC m=+361.808420605"
Sep 12 02:42:09.767040 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.766928    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8464796d4-p5vhq"]
Sep 12 02:42:09.770061 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.770036    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.772964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.772935    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 12 02:42:09.772964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.772959    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 12 02:42:09.773174 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.773044    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 12 02:42:09.773174 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.773089    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 12 02:42:09.773174 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.773091    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 12 02:42:09.773325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.773305    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2xwmh\""
Sep 12 02:42:09.778221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.778159    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 12 02:42:09.784289 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.784263    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8464796d4-p5vhq"]
Sep 12 02:42:09.924685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.924863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-secret-telemeter-client\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.924863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-serving-certs-ca-bundle\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.924863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-federate-client-tls\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.924863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924787    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvh7r\" (UniqueName: \"kubernetes.io/projected/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-kube-api-access-gvh7r\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.924863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.924863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-metrics-client-ca\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:09.925051 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:09.924969    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-telemeter-client-tls\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.025747 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025698    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-serving-certs-ca-bundle\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.025914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025769    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-federate-client-tls\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.025914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvh7r\" (UniqueName: \"kubernetes.io/projected/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-kube-api-access-gvh7r\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.025914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.025914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-metrics-client-ca\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.025914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025910    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-telemeter-client-tls\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.026200 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.026200 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.025995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-secret-telemeter-client\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.026835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.026582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-serving-certs-ca-bundle\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.026835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.026767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.027016 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.026964    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-metrics-client-ca\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.028586 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.028518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-telemeter-client-tls\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.028689 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.028590    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.028899 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.028877    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-secret-telemeter-client\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.028939 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.028883    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-federate-client-tls\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.035801 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.035776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvh7r\" (UniqueName: \"kubernetes.io/projected/0aa2ed16-6253-4ceb-afc8-3167a9b5c386-kube-api-access-gvh7r\") pod \"telemeter-client-8464796d4-p5vhq\" (UID: \"0aa2ed16-6253-4ceb-afc8-3167a9b5c386\") " pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.081445 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.081390    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq"
Sep 12 02:42:10.364762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.364726    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8464796d4-p5vhq"]
Sep 12 02:42:10.368937 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:42:10.368900    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa2ed16_6253_4ceb_afc8_3167a9b5c386.slice/crio-fa1655e345230a3c08fd82473f8f683091f380eae1cdc92b576def02d7303876 WatchSource:0}: Error finding container fa1655e345230a3c08fd82473f8f683091f380eae1cdc92b576def02d7303876: Status 404 returned error can't find the container with id fa1655e345230a3c08fd82473f8f683091f380eae1cdc92b576def02d7303876
Sep 12 02:42:10.532707 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:10.532669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq" event={"ID":"0aa2ed16-6253-4ceb-afc8-3167a9b5c386","Type":"ContainerStarted","Data":"fa1655e345230a3c08fd82473f8f683091f380eae1cdc92b576def02d7303876"}
Sep 12 02:42:12.543224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.543132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq" event={"ID":"0aa2ed16-6253-4ceb-afc8-3167a9b5c386","Type":"ContainerStarted","Data":"f43862261bf03b452487374fecb77e93d78023fbc15bdab4e7b55578b5fe3fc9"}
Sep 12 02:42:12.543224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.543198    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq" event={"ID":"0aa2ed16-6253-4ceb-afc8-3167a9b5c386","Type":"ContainerStarted","Data":"5c3d5609dfd6510649b8eb964e48f17576d41f5ce7a0d404b2453abbe1de7841"}
Sep 12 02:42:12.543224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.543222    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq" event={"ID":"0aa2ed16-6253-4ceb-afc8-3167a9b5c386","Type":"ContainerStarted","Data":"e0a83151bcd8cc4ff8bca9ab5410d4516bcdbf990dfc8ea806f1e38f042804fc"}
Sep 12 02:42:12.564957 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.564909    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8464796d4-p5vhq" podStartSLOduration=1.7353814330000001 podStartE2EDuration="3.564892954s" totalImagesPullingTime="1.829511521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:42:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:42:12.562523954 +0000 UTC m=+364.818504970" watchObservedRunningTime="2026-09-12 02:42:12.564892954 +0000 UTC m=+364.820873978"
Sep 12 02:42:12.643647 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.643612    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bb9cdf65f-m7wfk"]
Sep 12 02:42:12.646375 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.646345    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.658171 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.658134    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb9cdf65f-m7wfk"]
Sep 12 02:42:12.752547 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752505    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-oauth-config\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.752742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-service-ca\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.752742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-trusted-ca-bundle\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.752742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-serving-cert\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.752742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-config\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.752924 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-oauth-serving-cert\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.752924 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.752821    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p44h4\" (UniqueName: \"kubernetes.io/projected/ab58a902-985f-4c90-b2f5-6dbf50ee0451-kube-api-access-p44h4\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.853775 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.853734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-service-ca\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.853775 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.853774    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-trusted-ca-bundle\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.853795    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-serving-cert\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.853930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-config\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.854006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-oauth-serving-cert\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854196 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.854062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p44h4\" (UniqueName: \"kubernetes.io/projected/ab58a902-985f-4c90-b2f5-6dbf50ee0451-kube-api-access-p44h4\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854196 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.854156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-oauth-config\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854772 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.854742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-config\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854908 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.854785    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-oauth-serving-cert\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.854908 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.854745    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-service-ca\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.855274 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.855256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-trusted-ca-bundle\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.856422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.856381    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-oauth-config\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.856531 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.856507    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-serving-cert\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.862874 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.862844    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p44h4\" (UniqueName: \"kubernetes.io/projected/ab58a902-985f-4c90-b2f5-6dbf50ee0451-kube-api-access-p44h4\") pod \"console-bb9cdf65f-m7wfk\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") " pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:12.957001 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:12.956958    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:13.244270 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:13.244185    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bb9cdf65f-m7wfk"]
Sep 12 02:42:13.249485 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:42:13.249457    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab58a902_985f_4c90_b2f5_6dbf50ee0451.slice/crio-7808004d4e3bc7209f8be58617490f7c1d67a3eb0bec7c512d0d6d0944645d64 WatchSource:0}: Error finding container 7808004d4e3bc7209f8be58617490f7c1d67a3eb0bec7c512d0d6d0944645d64: Status 404 returned error can't find the container with id 7808004d4e3bc7209f8be58617490f7c1d67a3eb0bec7c512d0d6d0944645d64
Sep 12 02:42:13.548511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:13.548424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9cdf65f-m7wfk" event={"ID":"ab58a902-985f-4c90-b2f5-6dbf50ee0451","Type":"ContainerStarted","Data":"d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2"}
Sep 12 02:42:13.548511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:13.548478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9cdf65f-m7wfk" event={"ID":"ab58a902-985f-4c90-b2f5-6dbf50ee0451","Type":"ContainerStarted","Data":"7808004d4e3bc7209f8be58617490f7c1d67a3eb0bec7c512d0d6d0944645d64"}
Sep 12 02:42:13.566441 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:13.566382    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bb9cdf65f-m7wfk" podStartSLOduration=1.566364785 podStartE2EDuration="1.566364785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:42:13.564204515 +0000 UTC m=+365.820185530" watchObservedRunningTime="2026-09-12 02:42:13.566364785 +0000 UTC m=+365.822345800"
Sep 12 02:42:21.015230 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:21.015193    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:42:21.017365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:21.017346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79a51ccb-246e-44da-9d05-ec1c2a395d1a-metrics-certs\") pod \"network-metrics-daemon-vt47l\" (UID: \"79a51ccb-246e-44da-9d05-ec1c2a395d1a\") " pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:42:21.258017 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:21.257987    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k9jkq\""
Sep 12 02:42:21.265960 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:21.265911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vt47l"
Sep 12 02:42:21.530313 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:21.530282    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vt47l"]
Sep 12 02:42:21.532398 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:42:21.532374    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a51ccb_246e_44da_9d05_ec1c2a395d1a.slice/crio-58e3f5e77b68fd6dfacd2fc68ebe24a5bd1db98ffe7a9fa876a1145ed0c37357 WatchSource:0}: Error finding container 58e3f5e77b68fd6dfacd2fc68ebe24a5bd1db98ffe7a9fa876a1145ed0c37357: Status 404 returned error can't find the container with id 58e3f5e77b68fd6dfacd2fc68ebe24a5bd1db98ffe7a9fa876a1145ed0c37357
Sep 12 02:42:21.582476 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:21.582437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vt47l" event={"ID":"79a51ccb-246e-44da-9d05-ec1c2a395d1a","Type":"ContainerStarted","Data":"58e3f5e77b68fd6dfacd2fc68ebe24a5bd1db98ffe7a9fa876a1145ed0c37357"}
Sep 12 02:42:22.958261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:22.958224    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:22.958708 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:22.958297    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:22.964897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:22.964868    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:23.591961 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:23.591927    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vt47l" event={"ID":"79a51ccb-246e-44da-9d05-ec1c2a395d1a","Type":"ContainerStarted","Data":"219386f6447548256dc04a9f84daff11e99fe31e5add568c2e437d695d3e17b6"}
Sep 12 02:42:23.592143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:23.591986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vt47l" event={"ID":"79a51ccb-246e-44da-9d05-ec1c2a395d1a","Type":"ContainerStarted","Data":"87907640ae679ba460dba8e8392612bbe3f860fcf8625b0f65be67f11f18a8ca"}
Sep 12 02:42:23.595603 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:23.595579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:42:23.616717 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:23.616671    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vt47l" podStartSLOduration=374.120887852 podStartE2EDuration="6m15.616655821s" totalImagesPullingTime="1.495767969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:42:23.615371845 +0000 UTC m=+375.871352870" watchObservedRunningTime="2026-09-12 02:42:23.616655821 +0000 UTC m=+375.872636835"
Sep 12 02:42:23.668381 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:23.668348    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8fcb44f84-g4pcx"]
Sep 12 02:42:48.691612 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:48.691557    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8fcb44f84-g4pcx" podUID="97165d84-ae86-4811-bfe0-09aba82a924a" containerName="console" containerID="cri-o://988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c" gracePeriod=15
Sep 12 02:42:48.936769 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:48.936743    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:42:49.046325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046213    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-oauth-config\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046273    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-trusted-ca-bundle\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046301    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-service-ca\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046330    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-oauth-serving-cert\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046682 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046359    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-console-config\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046682 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjspv\" (UniqueName: \"kubernetes.io/projected/97165d84-ae86-4811-bfe0-09aba82a924a-kube-api-access-hjspv\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046682 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046503    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-serving-cert\") pod \"97165d84-ae86-4811-bfe0-09aba82a924a\" (UID: \"97165d84-ae86-4811-bfe0-09aba82a924a\") "
Sep 12 02:42:49.046831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046802    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-console-config" (OuterVolumeSpecName: "console-config") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:42:49.046890 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046818    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:42:49.046890 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046835    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:42:49.046890 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.046799    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-service-ca" (OuterVolumeSpecName: "service-ca") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:42:49.048417 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.048380    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:49.048593 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.048570    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97165d84-ae86-4811-bfe0-09aba82a924a-kube-api-access-hjspv" (OuterVolumeSpecName: "kube-api-access-hjspv") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "kube-api-access-hjspv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:42:49.048642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.048579    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "97165d84-ae86-4811-bfe0-09aba82a924a" (UID: "97165d84-ae86-4811-bfe0-09aba82a924a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:42:49.148093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148063    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.148093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148083    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/97165d84-ae86-4811-bfe0-09aba82a924a-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.148093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148094    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.148308 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148103    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.148308 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148111    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.148308 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148119    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/97165d84-ae86-4811-bfe0-09aba82a924a-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.148308 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.148126    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjspv\" (UniqueName: \"kubernetes.io/projected/97165d84-ae86-4811-bfe0-09aba82a924a-kube-api-access-hjspv\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:42:49.697521 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.697485    2583 generic.go:356] "Generic (PLEG): container finished" podID="97165d84-ae86-4811-bfe0-09aba82a924a" containerID="988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c" exitCode=0
Sep 12 02:42:49.697933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.697528    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcb44f84-g4pcx" event={"ID":"97165d84-ae86-4811-bfe0-09aba82a924a","Type":"ContainerDied","Data":"988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c"}
Sep 12 02:42:49.697933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.697551    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8fcb44f84-g4pcx"
Sep 12 02:42:49.697933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.697576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8fcb44f84-g4pcx" event={"ID":"97165d84-ae86-4811-bfe0-09aba82a924a","Type":"ContainerDied","Data":"77753e717bd036f7bdeb640ced045ca1594c64d82acf00291536f49a2eb78976"}
Sep 12 02:42:49.697933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.697605    2583 scope.go:117] "RemoveContainer" containerID="988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c"
Sep 12 02:42:49.706905 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.706887    2583 scope.go:117] "RemoveContainer" containerID="988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c"
Sep 12 02:42:49.707183 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:42:49.707159    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c\": container with ID starting with 988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c not found: ID does not exist" containerID="988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c"
Sep 12 02:42:49.707231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.707193    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c"} err="failed to get container status \"988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c\": rpc error: code = NotFound desc = could not find container \"988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c\": container with ID starting with 988d6bc544f52e2f57eda0a13c0cae022ab67fb1b9e0f99993484254e0a8f62c not found: ID does not exist"
Sep 12 02:42:49.718884 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.718861    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8fcb44f84-g4pcx"]
Sep 12 02:42:49.721987 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:49.721965    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8fcb44f84-g4pcx"]
Sep 12 02:42:50.159844 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:42:50.159813    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97165d84-ae86-4811-bfe0-09aba82a924a" path="/var/lib/kubelet/pods/97165d84-ae86-4811-bfe0-09aba82a924a/volumes"
Sep 12 02:43:37.405317 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.405246    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d886c747f-zstb7"]
Sep 12 02:43:37.405793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.405702    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97165d84-ae86-4811-bfe0-09aba82a924a" containerName="console"
Sep 12 02:43:37.405793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.405718    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97165d84-ae86-4811-bfe0-09aba82a924a" containerName="console"
Sep 12 02:43:37.405870 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.405834    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97165d84-ae86-4811-bfe0-09aba82a924a" containerName="console"
Sep 12 02:43:37.408892 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.408868    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.419595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.419575    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d886c747f-zstb7"]
Sep 12 02:43:37.515958 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.515923    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-serving-cert\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.516114 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.515975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-trusted-ca-bundle\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.516114 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.516028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-oauth-serving-cert\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.516114 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.516049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-service-ca\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.516114 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.516090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5m4\" (UniqueName: \"kubernetes.io/projected/f3b33740-b9ed-407d-b7eb-d9078c1a321d-kube-api-access-jz5m4\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.516316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.516187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-oauth-config\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.516316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.516225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-config\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617471 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617442    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-trusted-ca-bundle\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617645 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617490    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-oauth-serving-cert\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617645 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-service-ca\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617645 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz5m4\" (UniqueName: \"kubernetes.io/projected/f3b33740-b9ed-407d-b7eb-d9078c1a321d-kube-api-access-jz5m4\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617805 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-oauth-config\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617805 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-config\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.617805 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.617726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-serving-cert\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.618227 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.618199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-service-ca\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.618227 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.618214    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-oauth-serving-cert\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.618365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.618336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-trusted-ca-bundle\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.618428 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.618390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-config\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.620004 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.619977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-oauth-config\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.620095 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.620068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-serving-cert\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.625546 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.625528    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz5m4\" (UniqueName: \"kubernetes.io/projected/f3b33740-b9ed-407d-b7eb-d9078c1a321d-kube-api-access-jz5m4\") pod \"console-5d886c747f-zstb7\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") " pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.717685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.717627    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:37.983948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:37.983842    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d886c747f-zstb7"]
Sep 12 02:43:37.986650 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:43:37.986615    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b33740_b9ed_407d_b7eb_d9078c1a321d.slice/crio-74bf137896af315e232c1094fdf287180488cfc3ae17392c9e63cf9c65d21f81 WatchSource:0}: Error finding container 74bf137896af315e232c1094fdf287180488cfc3ae17392c9e63cf9c65d21f81: Status 404 returned error can't find the container with id 74bf137896af315e232c1094fdf287180488cfc3ae17392c9e63cf9c65d21f81
Sep 12 02:43:38.890072 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:38.890032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d886c747f-zstb7" event={"ID":"f3b33740-b9ed-407d-b7eb-d9078c1a321d","Type":"ContainerStarted","Data":"14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0"}
Sep 12 02:43:38.890462 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:38.890116    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d886c747f-zstb7" event={"ID":"f3b33740-b9ed-407d-b7eb-d9078c1a321d","Type":"ContainerStarted","Data":"74bf137896af315e232c1094fdf287180488cfc3ae17392c9e63cf9c65d21f81"}
Sep 12 02:43:38.906770 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:38.906722    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d886c747f-zstb7" podStartSLOduration=1.906709718 podStartE2EDuration="1.906709718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:43:38.904966735 +0000 UTC m=+451.160947749" watchObservedRunningTime="2026-09-12 02:43:38.906709718 +0000 UTC m=+451.162690732"
Sep 12 02:43:47.717983 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:47.717949    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:47.718452 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:47.718233    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:47.722877 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:47.722856    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:47.929823 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:47.929793    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:43:47.971502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:43:47.971433    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb9cdf65f-m7wfk"]
Sep 12 02:44:12.996640 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:12.996582    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bb9cdf65f-m7wfk" podUID="ab58a902-985f-4c90-b2f5-6dbf50ee0451" containerName="console" containerID="cri-o://d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2" gracePeriod=15
Sep 12 02:44:13.237510 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.237486    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:44:13.400054 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400017    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-config\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400064    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-oauth-config\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400093    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-oauth-serving-cert\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-service-ca\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400163    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-trusted-ca-bundle\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400187    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p44h4\" (UniqueName: \"kubernetes.io/projected/ab58a902-985f-4c90-b2f5-6dbf50ee0451-kube-api-access-p44h4\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400320    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-serving-cert\") pod \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\" (UID: \"ab58a902-985f-4c90-b2f5-6dbf50ee0451\") "
Sep 12 02:44:13.400500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400435    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-config" (OuterVolumeSpecName: "console-config") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:44:13.400613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400588    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:44:13.400670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400619    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:44:13.400670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400645    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:13.400739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.400668    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:44:13.402203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.402176    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:44:13.402302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.402274    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:44:13.402347 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.402331    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab58a902-985f-4c90-b2f5-6dbf50ee0451-kube-api-access-p44h4" (OuterVolumeSpecName: "kube-api-access-p44h4") pod "ab58a902-985f-4c90-b2f5-6dbf50ee0451" (UID: "ab58a902-985f-4c90-b2f5-6dbf50ee0451"). InnerVolumeSpecName "kube-api-access-p44h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:44:13.501914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.501894    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:13.501914 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.501914    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:13.502016 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.501923    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:13.502016 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.501932    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab58a902-985f-4c90-b2f5-6dbf50ee0451-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:13.502016 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.501940    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p44h4\" (UniqueName: \"kubernetes.io/projected/ab58a902-985f-4c90-b2f5-6dbf50ee0451-kube-api-access-p44h4\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:13.502016 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:13.501950    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab58a902-985f-4c90-b2f5-6dbf50ee0451-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:14.031315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.031285    2583 generic.go:356] "Generic (PLEG): container finished" podID="ab58a902-985f-4c90-b2f5-6dbf50ee0451" containerID="d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2" exitCode=0
Sep 12 02:44:14.031708 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.031328    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bb9cdf65f-m7wfk"
Sep 12 02:44:14.031708 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.031370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9cdf65f-m7wfk" event={"ID":"ab58a902-985f-4c90-b2f5-6dbf50ee0451","Type":"ContainerDied","Data":"d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2"}
Sep 12 02:44:14.031708 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.031427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bb9cdf65f-m7wfk" event={"ID":"ab58a902-985f-4c90-b2f5-6dbf50ee0451","Type":"ContainerDied","Data":"7808004d4e3bc7209f8be58617490f7c1d67a3eb0bec7c512d0d6d0944645d64"}
Sep 12 02:44:14.031708 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.031448    2583 scope.go:117] "RemoveContainer" containerID="d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2"
Sep 12 02:44:14.044378 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.040995    2583 scope.go:117] "RemoveContainer" containerID="d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2"
Sep 12 02:44:14.044378 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:44:14.041300    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2\": container with ID starting with d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2 not found: ID does not exist" containerID="d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2"
Sep 12 02:44:14.044378 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.041343    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2"} err="failed to get container status \"d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2\": rpc error: code = NotFound desc = could not find container \"d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2\": container with ID starting with d5562bfeea51457f4691740560dd3e16d14e12ea5649ef90170285a5801467f2 not found: ID does not exist"
Sep 12 02:44:14.057247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.057221    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bb9cdf65f-m7wfk"]
Sep 12 02:44:14.060919 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.060899    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bb9cdf65f-m7wfk"]
Sep 12 02:44:14.159778 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:14.159757    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab58a902-985f-4c90-b2f5-6dbf50ee0451" path="/var/lib/kubelet/pods/ab58a902-985f-4c90-b2f5-6dbf50ee0451/volumes"
Sep 12 02:44:31.041295 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.041259    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"]
Sep 12 02:44:31.041743 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.041561    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab58a902-985f-4c90-b2f5-6dbf50ee0451" containerName="console"
Sep 12 02:44:31.041743 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.041572    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab58a902-985f-4c90-b2f5-6dbf50ee0451" containerName="console"
Sep 12 02:44:31.041743 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.041639    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab58a902-985f-4c90-b2f5-6dbf50ee0451" containerName="console"
Sep 12 02:44:31.045988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.045971    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.048498 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.048470    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c7z8z\""
Sep 12 02:44:31.048613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.048477    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 02:44:31.049433 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.049397    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 02:44:31.053381 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.053362    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"]
Sep 12 02:44:31.234742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.234712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.234875 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.234745    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.234875 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.234779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgqs2\" (UniqueName: \"kubernetes.io/projected/bd949ef5-11ba-4b60-b198-e8f3e88116ac-kube-api-access-cgqs2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.335530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.335503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.335665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.335539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.335737 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.335697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgqs2\" (UniqueName: \"kubernetes.io/projected/bd949ef5-11ba-4b60-b198-e8f3e88116ac-kube-api-access-cgqs2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.336013 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.335893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.336066 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.335910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.343535 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.343507    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgqs2\" (UniqueName: \"kubernetes.io/projected/bd949ef5-11ba-4b60-b198-e8f3e88116ac-kube-api-access-cgqs2\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.355275 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.355256    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:31.621636 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:31.621605    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"]
Sep 12 02:44:31.623866 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:44:31.623838    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd949ef5_11ba_4b60_b198_e8f3e88116ac.slice/crio-eeb3bf510ac3c00cc3688335e6cb8c11b9ff717a49499c06fd54bb4eb7f4335f WatchSource:0}: Error finding container eeb3bf510ac3c00cc3688335e6cb8c11b9ff717a49499c06fd54bb4eb7f4335f: Status 404 returned error can't find the container with id eeb3bf510ac3c00cc3688335e6cb8c11b9ff717a49499c06fd54bb4eb7f4335f
Sep 12 02:44:32.100987 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:32.100958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz" event={"ID":"bd949ef5-11ba-4b60-b198-e8f3e88116ac","Type":"ContainerStarted","Data":"eeb3bf510ac3c00cc3688335e6cb8c11b9ff717a49499c06fd54bb4eb7f4335f"}
Sep 12 02:44:38.128766 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:38.128727    2583 generic.go:356] "Generic (PLEG): container finished" podID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerID="c5d6f4b12d2b75364b1a3e487bc98472162abebcf6d6e35fefe84c3031c86b96" exitCode=0
Sep 12 02:44:38.129148 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:38.128810    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz" event={"ID":"bd949ef5-11ba-4b60-b198-e8f3e88116ac","Type":"ContainerDied","Data":"c5d6f4b12d2b75364b1a3e487bc98472162abebcf6d6e35fefe84c3031c86b96"}
Sep 12 02:44:41.142504 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:41.142463    2583 generic.go:356] "Generic (PLEG): container finished" podID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerID="106101ff12162cf00305d643765e44d00529899415ede0344a504a84ed65b493" exitCode=0
Sep 12 02:44:41.142880 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:41.142522    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz" event={"ID":"bd949ef5-11ba-4b60-b198-e8f3e88116ac","Type":"ContainerDied","Data":"106101ff12162cf00305d643765e44d00529899415ede0344a504a84ed65b493"}
Sep 12 02:44:48.175041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:48.175010    2583 generic.go:356] "Generic (PLEG): container finished" podID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerID="b18427f8e53dfc53fe7bf1844feed238e4cbf8348ba04f5838255b645055602a" exitCode=0
Sep 12 02:44:48.175499 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:48.175092    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz" event={"ID":"bd949ef5-11ba-4b60-b198-e8f3e88116ac","Type":"ContainerDied","Data":"b18427f8e53dfc53fe7bf1844feed238e4cbf8348ba04f5838255b645055602a"}
Sep 12 02:44:49.300194 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.300166    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:49.389952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.389919    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgqs2\" (UniqueName: \"kubernetes.io/projected/bd949ef5-11ba-4b60-b198-e8f3e88116ac-kube-api-access-cgqs2\") pod \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") "
Sep 12 02:44:49.390103 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.389977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-util\") pod \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") "
Sep 12 02:44:49.390103 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.390007    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-bundle\") pod \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\" (UID: \"bd949ef5-11ba-4b60-b198-e8f3e88116ac\") "
Sep 12 02:44:49.390704 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.390675    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-bundle" (OuterVolumeSpecName: "bundle") pod "bd949ef5-11ba-4b60-b198-e8f3e88116ac" (UID: "bd949ef5-11ba-4b60-b198-e8f3e88116ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:44:49.392047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.392021    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd949ef5-11ba-4b60-b198-e8f3e88116ac-kube-api-access-cgqs2" (OuterVolumeSpecName: "kube-api-access-cgqs2") pod "bd949ef5-11ba-4b60-b198-e8f3e88116ac" (UID: "bd949ef5-11ba-4b60-b198-e8f3e88116ac"). InnerVolumeSpecName "kube-api-access-cgqs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:44:49.394583 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.394561    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-util" (OuterVolumeSpecName: "util") pod "bd949ef5-11ba-4b60-b198-e8f3e88116ac" (UID: "bd949ef5-11ba-4b60-b198-e8f3e88116ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:44:49.490757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.490700    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:49.490757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.490723    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgqs2\" (UniqueName: \"kubernetes.io/projected/bd949ef5-11ba-4b60-b198-e8f3e88116ac-kube-api-access-cgqs2\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:49.490757 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:49.490733    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bd949ef5-11ba-4b60-b198-e8f3e88116ac-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:44:50.184690 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:50.184666    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz"
Sep 12 02:44:50.184690 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:50.184681    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540kwnfz" event={"ID":"bd949ef5-11ba-4b60-b198-e8f3e88116ac","Type":"ContainerDied","Data":"eeb3bf510ac3c00cc3688335e6cb8c11b9ff717a49499c06fd54bb4eb7f4335f"}
Sep 12 02:44:50.184854 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:50.184720    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eeb3bf510ac3c00cc3688335e6cb8c11b9ff717a49499c06fd54bb4eb7f4335f"
Sep 12 02:44:53.739211 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739177    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"]
Sep 12 02:44:53.739590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739516    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="pull"
Sep 12 02:44:53.739590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739528    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="pull"
Sep 12 02:44:53.739590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739538    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="extract"
Sep 12 02:44:53.739590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739543    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="extract"
Sep 12 02:44:53.739590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739559    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="util"
Sep 12 02:44:53.739590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739564    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="util"
Sep 12 02:44:53.739772 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.739616    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd949ef5-11ba-4b60-b198-e8f3e88116ac" containerName="extract"
Sep 12 02:44:53.742656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.742633    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:53.747439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.747422    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 12 02:44:53.747439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.747433    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gwc6x\""
Sep 12 02:44:53.748038 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.748021    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 12 02:44:53.766115 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.766092    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"]
Sep 12 02:44:53.822793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.822767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/181f2f58-f463-4d51-8888-e3d7d6ec4021-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pvtbn\" (UID: \"181f2f58-f463-4d51-8888-e3d7d6ec4021\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:53.822922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.822837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klntf\" (UniqueName: \"kubernetes.io/projected/181f2f58-f463-4d51-8888-e3d7d6ec4021-kube-api-access-klntf\") pod \"cert-manager-operator-controller-manager-55c444bf86-pvtbn\" (UID: \"181f2f58-f463-4d51-8888-e3d7d6ec4021\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:53.923530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.923502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klntf\" (UniqueName: \"kubernetes.io/projected/181f2f58-f463-4d51-8888-e3d7d6ec4021-kube-api-access-klntf\") pod \"cert-manager-operator-controller-manager-55c444bf86-pvtbn\" (UID: \"181f2f58-f463-4d51-8888-e3d7d6ec4021\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:53.923657 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.923563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/181f2f58-f463-4d51-8888-e3d7d6ec4021-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pvtbn\" (UID: \"181f2f58-f463-4d51-8888-e3d7d6ec4021\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:53.923930 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.923912    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/181f2f58-f463-4d51-8888-e3d7d6ec4021-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pvtbn\" (UID: \"181f2f58-f463-4d51-8888-e3d7d6ec4021\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:53.931390 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:53.931366    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klntf\" (UniqueName: \"kubernetes.io/projected/181f2f58-f463-4d51-8888-e3d7d6ec4021-kube-api-access-klntf\") pod \"cert-manager-operator-controller-manager-55c444bf86-pvtbn\" (UID: \"181f2f58-f463-4d51-8888-e3d7d6ec4021\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:54.051337 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:54.051272    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"
Sep 12 02:44:54.319990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:54.319966    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn"]
Sep 12 02:44:54.322216 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:44:54.322189    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod181f2f58_f463_4d51_8888_e3d7d6ec4021.slice/crio-0940cb27576a7688b8c2dc906dcb28752a1b2a38f5ca9bc0827eee2b88e54bdf WatchSource:0}: Error finding container 0940cb27576a7688b8c2dc906dcb28752a1b2a38f5ca9bc0827eee2b88e54bdf: Status 404 returned error can't find the container with id 0940cb27576a7688b8c2dc906dcb28752a1b2a38f5ca9bc0827eee2b88e54bdf
Sep 12 02:44:55.207740 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:55.207696    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn" event={"ID":"181f2f58-f463-4d51-8888-e3d7d6ec4021","Type":"ContainerStarted","Data":"0940cb27576a7688b8c2dc906dcb28752a1b2a38f5ca9bc0827eee2b88e54bdf"}
Sep 12 02:44:56.213846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:56.213807    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn" event={"ID":"181f2f58-f463-4d51-8888-e3d7d6ec4021","Type":"ContainerStarted","Data":"1fa370c2832c4369e27dfe9d5b66852a41ad3f0bb42dd02b55bda73c9dedf3d9"}
Sep 12 02:44:56.234090 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:56.234045    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pvtbn" podStartSLOduration=1.549311334 podStartE2EDuration="3.234029663s" totalImagesPullingTime="1.684718329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:44:56.232075733 +0000 UTC m=+528.488056757" watchObservedRunningTime="2026-09-12 02:44:56.234029663 +0000 UTC m=+528.490010677"
Sep 12 02:44:57.452639 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.452604    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"]
Sep 12 02:44:57.455015 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.454999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.457736 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.457712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 02:44:57.457903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.457712    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 02:44:57.458775 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.458756    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c7z8z\""
Sep 12 02:44:57.467280 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.467258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"]
Sep 12 02:44:57.553834 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.553808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pk4b\" (UniqueName: \"kubernetes.io/projected/95232d48-9edd-4684-a2c5-984812d8a843-kube-api-access-2pk4b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.553956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.553846    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.553956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.553880    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.655119 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.655092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.655246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.655143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pk4b\" (UniqueName: \"kubernetes.io/projected/95232d48-9edd-4684-a2c5-984812d8a843-kube-api-access-2pk4b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.655246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.655171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.655497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.655480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.655538 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.655515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.664434 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.664388    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pk4b\" (UniqueName: \"kubernetes.io/projected/95232d48-9edd-4684-a2c5-984812d8a843-kube-api-access-2pk4b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:57.763862 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:57.763808    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:44:58.031132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.031108    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"]
Sep 12 02:44:58.032853 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:44:58.032827    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95232d48_9edd_4684_a2c5_984812d8a843.slice/crio-5010163c61fbdab5eefa1126e9b6ef599fcb567c918dd431afad739699a6551f WatchSource:0}: Error finding container 5010163c61fbdab5eefa1126e9b6ef599fcb567c918dd431afad739699a6551f: Status 404 returned error can't find the container with id 5010163c61fbdab5eefa1126e9b6ef599fcb567c918dd431afad739699a6551f
Sep 12 02:44:58.223481 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.223446    2583 generic.go:356] "Generic (PLEG): container finished" podID="95232d48-9edd-4684-a2c5-984812d8a843" containerID="d7a9b216ec54c192cde750f51df2d03bd41a06714986291849461001ddc9b666" exitCode=0
Sep 12 02:44:58.223623 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.223531    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn" event={"ID":"95232d48-9edd-4684-a2c5-984812d8a843","Type":"ContainerDied","Data":"d7a9b216ec54c192cde750f51df2d03bd41a06714986291849461001ddc9b666"}
Sep 12 02:44:58.223623 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.223580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn" event={"ID":"95232d48-9edd-4684-a2c5-984812d8a843","Type":"ContainerStarted","Data":"5010163c61fbdab5eefa1126e9b6ef599fcb567c918dd431afad739699a6551f"}
Sep 12 02:44:58.572455 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.572422    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ffqn9"]
Sep 12 02:44:58.574379 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.574364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.576765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.576748    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 12 02:44:58.576765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.576755    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2zgbg\""
Sep 12 02:44:58.576920 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.576781    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 12 02:44:58.581920 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.581899    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ffqn9"]
Sep 12 02:44:58.663693 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.663663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjlw\" (UniqueName: \"kubernetes.io/projected/a3964c1a-40e8-4b0d-b4f8-b468c7113a51-kube-api-access-9kjlw\") pod \"cert-manager-webhook-6486ffd997-ffqn9\" (UID: \"a3964c1a-40e8-4b0d-b4f8-b468c7113a51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.663816 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.663704    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3964c1a-40e8-4b0d-b4f8-b468c7113a51-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ffqn9\" (UID: \"a3964c1a-40e8-4b0d-b4f8-b468c7113a51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.764336 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.764305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3964c1a-40e8-4b0d-b4f8-b468c7113a51-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ffqn9\" (UID: \"a3964c1a-40e8-4b0d-b4f8-b468c7113a51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.764490 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.764422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjlw\" (UniqueName: \"kubernetes.io/projected/a3964c1a-40e8-4b0d-b4f8-b468c7113a51-kube-api-access-9kjlw\") pod \"cert-manager-webhook-6486ffd997-ffqn9\" (UID: \"a3964c1a-40e8-4b0d-b4f8-b468c7113a51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.771969 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.771946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3964c1a-40e8-4b0d-b4f8-b468c7113a51-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ffqn9\" (UID: \"a3964c1a-40e8-4b0d-b4f8-b468c7113a51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.772169 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.772151    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjlw\" (UniqueName: \"kubernetes.io/projected/a3964c1a-40e8-4b0d-b4f8-b468c7113a51-kube-api-access-9kjlw\") pod \"cert-manager-webhook-6486ffd997-ffqn9\" (UID: \"a3964c1a-40e8-4b0d-b4f8-b468c7113a51\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:58.883285 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:58.883229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:44:59.152520 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:59.152492    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ffqn9"]
Sep 12 02:44:59.154777 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:44:59.154750    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3964c1a_40e8_4b0d_b4f8_b468c7113a51.slice/crio-fb728121e6eaa9557d34da747f5e24b5551c336e6ed99f2f82f54cf46b9a9c84 WatchSource:0}: Error finding container fb728121e6eaa9557d34da747f5e24b5551c336e6ed99f2f82f54cf46b9a9c84: Status 404 returned error can't find the container with id fb728121e6eaa9557d34da747f5e24b5551c336e6ed99f2f82f54cf46b9a9c84
Sep 12 02:44:59.230081 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:44:59.230051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9" event={"ID":"a3964c1a-40e8-4b0d-b4f8-b468c7113a51","Type":"ContainerStarted","Data":"fb728121e6eaa9557d34da747f5e24b5551c336e6ed99f2f82f54cf46b9a9c84"}
Sep 12 02:45:01.244671 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:01.244630    2583 generic.go:356] "Generic (PLEG): container finished" podID="95232d48-9edd-4684-a2c5-984812d8a843" containerID="24fe6ea5457b4c95304d6210f7b9ff0e4da41e458bdb3f3209b1d642f9ce2b97" exitCode=0
Sep 12 02:45:01.245139 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:01.244714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn" event={"ID":"95232d48-9edd-4684-a2c5-984812d8a843","Type":"ContainerDied","Data":"24fe6ea5457b4c95304d6210f7b9ff0e4da41e458bdb3f3209b1d642f9ce2b97"}
Sep 12 02:45:02.251868 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:02.251834    2583 generic.go:356] "Generic (PLEG): container finished" podID="95232d48-9edd-4684-a2c5-984812d8a843" containerID="519990e0f0d4b049fed31d5938b82c30c6cb1d46728255f39d82a498184b9d7e" exitCode=0
Sep 12 02:45:02.252296 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:02.251879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn" event={"ID":"95232d48-9edd-4684-a2c5-984812d8a843","Type":"ContainerDied","Data":"519990e0f0d4b049fed31d5938b82c30c6cb1d46728255f39d82a498184b9d7e"}
Sep 12 02:45:03.257288 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.257256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9" event={"ID":"a3964c1a-40e8-4b0d-b4f8-b468c7113a51","Type":"ContainerStarted","Data":"0b746829b0938be7cf96785a203a58398b9bfbee01511587ab8d5f509437134b"}
Sep 12 02:45:03.257676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.257315    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:45:03.276709 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.276663    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9" podStartSLOduration=1.270515188 podStartE2EDuration="5.276648512s" totalImagesPullingTime="4.006133324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:45:03.27471908 +0000 UTC m=+535.530700091" watchObservedRunningTime="2026-09-12 02:45:03.276648512 +0000 UTC m=+535.532629528"
Sep 12 02:45:03.382579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.382556    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:45:03.508438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.508356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-bundle\") pod \"95232d48-9edd-4684-a2c5-984812d8a843\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") "
Sep 12 02:45:03.508438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.508389    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pk4b\" (UniqueName: \"kubernetes.io/projected/95232d48-9edd-4684-a2c5-984812d8a843-kube-api-access-2pk4b\") pod \"95232d48-9edd-4684-a2c5-984812d8a843\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") "
Sep 12 02:45:03.508637 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.508453    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-util\") pod \"95232d48-9edd-4684-a2c5-984812d8a843\" (UID: \"95232d48-9edd-4684-a2c5-984812d8a843\") "
Sep 12 02:45:03.508808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.508788    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-bundle" (OuterVolumeSpecName: "bundle") pod "95232d48-9edd-4684-a2c5-984812d8a843" (UID: "95232d48-9edd-4684-a2c5-984812d8a843"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:45:03.510414 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.510379    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95232d48-9edd-4684-a2c5-984812d8a843-kube-api-access-2pk4b" (OuterVolumeSpecName: "kube-api-access-2pk4b") pod "95232d48-9edd-4684-a2c5-984812d8a843" (UID: "95232d48-9edd-4684-a2c5-984812d8a843"). InnerVolumeSpecName "kube-api-access-2pk4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:45:03.541205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.541170    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-util" (OuterVolumeSpecName: "util") pod "95232d48-9edd-4684-a2c5-984812d8a843" (UID: "95232d48-9edd-4684-a2c5-984812d8a843"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:45:03.610019 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.609995    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:03.610019 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.610017    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pk4b\" (UniqueName: \"kubernetes.io/projected/95232d48-9edd-4684-a2c5-984812d8a843-kube-api-access-2pk4b\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:03.610145 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:03.610027    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/95232d48-9edd-4684-a2c5-984812d8a843-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:04.263348 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:04.263322    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn"
Sep 12 02:45:04.263687 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:04.263350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fjdhjn" event={"ID":"95232d48-9edd-4684-a2c5-984812d8a843","Type":"ContainerDied","Data":"5010163c61fbdab5eefa1126e9b6ef599fcb567c918dd431afad739699a6551f"}
Sep 12 02:45:04.263687 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:04.263393    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5010163c61fbdab5eefa1126e9b6ef599fcb567c918dd431afad739699a6551f"
Sep 12 02:45:07.860795 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.860765    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c2pqx"]
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861064    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="util"
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861074    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="util"
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861095    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="pull"
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861101    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="pull"
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861108    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="extract"
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861113    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="extract"
Sep 12 02:45:07.861201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.861171    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="95232d48-9edd-4684-a2c5-984812d8a843" containerName="extract"
Sep 12 02:45:07.865166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.865149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:07.867602 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.867583    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t99zf\""
Sep 12 02:45:07.873848 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.873827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c2pqx"]
Sep 12 02:45:07.941462 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.941440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q75h\" (UniqueName: \"kubernetes.io/projected/d13f007f-3362-4ea8-849f-10f455c5810a-kube-api-access-6q75h\") pod \"cert-manager-55b4d954d5-c2pqx\" (UID: \"d13f007f-3362-4ea8-849f-10f455c5810a\") " pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:07.941579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:07.941468    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13f007f-3362-4ea8-849f-10f455c5810a-bound-sa-token\") pod \"cert-manager-55b4d954d5-c2pqx\" (UID: \"d13f007f-3362-4ea8-849f-10f455c5810a\") " pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:08.042546 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.042521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q75h\" (UniqueName: \"kubernetes.io/projected/d13f007f-3362-4ea8-849f-10f455c5810a-kube-api-access-6q75h\") pod \"cert-manager-55b4d954d5-c2pqx\" (UID: \"d13f007f-3362-4ea8-849f-10f455c5810a\") " pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:08.042647 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.042550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13f007f-3362-4ea8-849f-10f455c5810a-bound-sa-token\") pod \"cert-manager-55b4d954d5-c2pqx\" (UID: \"d13f007f-3362-4ea8-849f-10f455c5810a\") " pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:08.050791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.050764    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d13f007f-3362-4ea8-849f-10f455c5810a-bound-sa-token\") pod \"cert-manager-55b4d954d5-c2pqx\" (UID: \"d13f007f-3362-4ea8-849f-10f455c5810a\") " pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:08.051015 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.050988    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q75h\" (UniqueName: \"kubernetes.io/projected/d13f007f-3362-4ea8-849f-10f455c5810a-kube-api-access-6q75h\") pod \"cert-manager-55b4d954d5-c2pqx\" (UID: \"d13f007f-3362-4ea8-849f-10f455c5810a\") " pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:08.177534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.177510    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t99zf\""
Sep 12 02:45:08.185903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.185883    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-c2pqx"
Sep 12 02:45:08.456003 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:08.455982    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-c2pqx"]
Sep 12 02:45:08.457720 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:45:08.457692    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd13f007f_3362_4ea8_849f_10f455c5810a.slice/crio-df479117596f07b7e898d49e3d0e454fbb3a6075ef0f66845ba44057057a3c10 WatchSource:0}: Error finding container df479117596f07b7e898d49e3d0e454fbb3a6075ef0f66845ba44057057a3c10: Status 404 returned error can't find the container with id df479117596f07b7e898d49e3d0e454fbb3a6075ef0f66845ba44057057a3c10
Sep 12 02:45:09.265254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:09.265228    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ffqn9"
Sep 12 02:45:09.287186 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:09.287154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c2pqx" event={"ID":"d13f007f-3362-4ea8-849f-10f455c5810a","Type":"ContainerStarted","Data":"1ef154905120af8bb438fa04be735458d08a0bd8e24aec2ba84cd5c7f8c676f0"}
Sep 12 02:45:09.287356 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:09.287199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-c2pqx" event={"ID":"d13f007f-3362-4ea8-849f-10f455c5810a","Type":"ContainerStarted","Data":"df479117596f07b7e898d49e3d0e454fbb3a6075ef0f66845ba44057057a3c10"}
Sep 12 02:45:09.301051 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:09.300998    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-c2pqx" podStartSLOduration=2.300979282 podStartE2EDuration="2.300979282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:45:09.300552246 +0000 UTC m=+541.556533262" watchObservedRunningTime="2026-09-12 02:45:09.300979282 +0000 UTC m=+541.556960296"
Sep 12 02:45:14.226271 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.226218    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"]
Sep 12 02:45:14.230290 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.230266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.230290 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.230276    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"]
Sep 12 02:45:14.232641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.232621    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c7z8z\""
Sep 12 02:45:14.232858 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.232651    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 02:45:14.233069 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.232651    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 02:45:14.393207 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.393177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.393328 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.393218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.393328 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.393260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztxjr\" (UniqueName: \"kubernetes.io/projected/fb4d0652-fdde-43c1-a743-d22a4887fe30-kube-api-access-ztxjr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.493712 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.493645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.493712 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.493689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.493856 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.493719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztxjr\" (UniqueName: \"kubernetes.io/projected/fb4d0652-fdde-43c1-a743-d22a4887fe30-kube-api-access-ztxjr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.493992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.493973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.494036 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.494019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.501031 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.501006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztxjr\" (UniqueName: \"kubernetes.io/projected/fb4d0652-fdde-43c1-a743-d22a4887fe30-kube-api-access-ztxjr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.540389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.540368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:14.806497 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:14.806474    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"]
Sep 12 02:45:14.808225 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:45:14.808196    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb4d0652_fdde_43c1_a743_d22a4887fe30.slice/crio-080e60250ae3b42364b9727e5716526ea3cbdab7fc6e47ea61736893ac0a301d WatchSource:0}: Error finding container 080e60250ae3b42364b9727e5716526ea3cbdab7fc6e47ea61736893ac0a301d: Status 404 returned error can't find the container with id 080e60250ae3b42364b9727e5716526ea3cbdab7fc6e47ea61736893ac0a301d
Sep 12 02:45:15.315359 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:15.315321    2583 generic.go:356] "Generic (PLEG): container finished" podID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerID="d888e2195596955bfb5a9d88e49f677ec345642b73f1be2bb380bacdc0083b41" exitCode=0
Sep 12 02:45:15.315734 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:15.315392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8" event={"ID":"fb4d0652-fdde-43c1-a743-d22a4887fe30","Type":"ContainerDied","Data":"d888e2195596955bfb5a9d88e49f677ec345642b73f1be2bb380bacdc0083b41"}
Sep 12 02:45:15.315734 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:15.315464    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8" event={"ID":"fb4d0652-fdde-43c1-a743-d22a4887fe30","Type":"ContainerStarted","Data":"080e60250ae3b42364b9727e5716526ea3cbdab7fc6e47ea61736893ac0a301d"}
Sep 12 02:45:16.321302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:16.321272    2583 generic.go:356] "Generic (PLEG): container finished" podID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerID="fd1ae921927d8cef152a0ecd7fc816ef298ca1965e5eeafd70c460c4a1cc816e" exitCode=0
Sep 12 02:45:16.321665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:16.321322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8" event={"ID":"fb4d0652-fdde-43c1-a743-d22a4887fe30","Type":"ContainerDied","Data":"fd1ae921927d8cef152a0ecd7fc816ef298ca1965e5eeafd70c460c4a1cc816e"}
Sep 12 02:45:17.327295 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:17.327264    2583 generic.go:356] "Generic (PLEG): container finished" podID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerID="e339385b194a1a162f88fff90172ec5531baa58e890b63021223da1bd324b733" exitCode=0
Sep 12 02:45:17.327693 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:17.327330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8" event={"ID":"fb4d0652-fdde-43c1-a743-d22a4887fe30","Type":"ContainerDied","Data":"e339385b194a1a162f88fff90172ec5531baa58e890b63021223da1bd324b733"}
Sep 12 02:45:18.460377 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.460346    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:18.629441 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.629353    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztxjr\" (UniqueName: \"kubernetes.io/projected/fb4d0652-fdde-43c1-a743-d22a4887fe30-kube-api-access-ztxjr\") pod \"fb4d0652-fdde-43c1-a743-d22a4887fe30\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") "
Sep 12 02:45:18.629441 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.629391    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-util\") pod \"fb4d0652-fdde-43c1-a743-d22a4887fe30\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") "
Sep 12 02:45:18.629631 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.629465    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-bundle\") pod \"fb4d0652-fdde-43c1-a743-d22a4887fe30\" (UID: \"fb4d0652-fdde-43c1-a743-d22a4887fe30\") "
Sep 12 02:45:18.630162 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.630136    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-bundle" (OuterVolumeSpecName: "bundle") pod "fb4d0652-fdde-43c1-a743-d22a4887fe30" (UID: "fb4d0652-fdde-43c1-a743-d22a4887fe30"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:45:18.631450 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.631399    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb4d0652-fdde-43c1-a743-d22a4887fe30-kube-api-access-ztxjr" (OuterVolumeSpecName: "kube-api-access-ztxjr") pod "fb4d0652-fdde-43c1-a743-d22a4887fe30" (UID: "fb4d0652-fdde-43c1-a743-d22a4887fe30"). InnerVolumeSpecName "kube-api-access-ztxjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:45:18.636066 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.636046    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-util" (OuterVolumeSpecName: "util") pod "fb4d0652-fdde-43c1-a743-d22a4887fe30" (UID: "fb4d0652-fdde-43c1-a743-d22a4887fe30"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:45:18.730443 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.730395    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztxjr\" (UniqueName: \"kubernetes.io/projected/fb4d0652-fdde-43c1-a743-d22a4887fe30-kube-api-access-ztxjr\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:18.730443 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.730439    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:18.730583 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:18.730453    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb4d0652-fdde-43c1-a743-d22a4887fe30-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:19.337557 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:19.337527    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8"
Sep 12 02:45:19.337557 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:19.337545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afk2hp8" event={"ID":"fb4d0652-fdde-43c1-a743-d22a4887fe30","Type":"ContainerDied","Data":"080e60250ae3b42364b9727e5716526ea3cbdab7fc6e47ea61736893ac0a301d"}
Sep 12 02:45:19.337759 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:19.337587    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="080e60250ae3b42364b9727e5716526ea3cbdab7fc6e47ea61736893ac0a301d"
Sep 12 02:45:28.058766 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.058733    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"]
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059049    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="util"
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059059    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="util"
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059067    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="extract"
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059072    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="extract"
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059081    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="pull"
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059086    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="pull"
Sep 12 02:45:28.059191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.059140    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb4d0652-fdde-43c1-a743-d22a4887fe30" containerName="extract"
Sep 12 02:45:28.061674 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.061658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.064298 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.064275    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 02:45:28.064428 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.064280    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 02:45:28.065287 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.065269    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c7z8z\""
Sep 12 02:45:28.071389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.071371    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"]
Sep 12 02:45:28.135349 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.135323    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"]
Sep 12 02:45:28.137316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.137303    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.140238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.140218    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 12 02:45:28.140558 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.140543    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 12 02:45:28.140558 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.140551    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 12 02:45:28.142587 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.142570    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 12 02:45:28.142662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.142590    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 12 02:45:28.142992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.142975    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vpxgb\""
Sep 12 02:45:28.165893 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.165872    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"]
Sep 12 02:45:28.210156 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.210132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.210302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.210162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvpgm\" (UniqueName: \"kubernetes.io/projected/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-kube-api-access-vvpgm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.210302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.210203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.311060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.310985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e289c213-280b-4e10-b84a-345da8f0cbd5-metrics-cert\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.311060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.311060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e289c213-280b-4e10-b84a-345da8f0cbd5-cert\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.311270 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2l46\" (UniqueName: \"kubernetes.io/projected/e289c213-280b-4e10-b84a-345da8f0cbd5-kube-api-access-g2l46\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.311270 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311159    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e289c213-280b-4e10-b84a-345da8f0cbd5-manager-config\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.311270 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.311270 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvpgm\" (UniqueName: \"kubernetes.io/projected/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-kube-api-access-vvpgm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.311463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.311463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.311455    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.322801 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.322771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvpgm\" (UniqueName: \"kubernetes.io/projected/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-kube-api-access-vvpgm\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.371548 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.371516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:28.412590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.412562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e289c213-280b-4e10-b84a-345da8f0cbd5-manager-config\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.412753 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.412728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e289c213-280b-4e10-b84a-345da8f0cbd5-metrics-cert\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.412808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.412789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e289c213-280b-4e10-b84a-345da8f0cbd5-cert\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.412858 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.412818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2l46\" (UniqueName: \"kubernetes.io/projected/e289c213-280b-4e10-b84a-345da8f0cbd5-kube-api-access-g2l46\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.413343 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.413293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e289c213-280b-4e10-b84a-345da8f0cbd5-manager-config\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.415816 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.415706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e289c213-280b-4e10-b84a-345da8f0cbd5-cert\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.416764 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.416740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e289c213-280b-4e10-b84a-345da8f0cbd5-metrics-cert\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.422146 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.422119    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2l46\" (UniqueName: \"kubernetes.io/projected/e289c213-280b-4e10-b84a-345da8f0cbd5-kube-api-access-g2l46\") pod \"lws-controller-manager-6645c7894d-cmmcn\" (UID: \"e289c213-280b-4e10-b84a-345da8f0cbd5\") " pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.445612 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.445586    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:28.640054 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.640033    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"]
Sep 12 02:45:28.715686 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:28.715657    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"]
Sep 12 02:45:28.717396 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:45:28.717370    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode289c213_280b_4e10_b84a_345da8f0cbd5.slice/crio-c952f502047b729d3ba6ae858ed8e7439240ed87363350108a2af83db025b076 WatchSource:0}: Error finding container c952f502047b729d3ba6ae858ed8e7439240ed87363350108a2af83db025b076: Status 404 returned error can't find the container with id c952f502047b729d3ba6ae858ed8e7439240ed87363350108a2af83db025b076
Sep 12 02:45:29.224980 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.224949    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"]
Sep 12 02:45:29.227500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.227481    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.230744 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.230720    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 12 02:45:29.230863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.230783    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 12 02:45:29.230994 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.230980    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 12 02:45:29.231349 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.231331    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dx684\""
Sep 12 02:45:29.231458 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.231364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 12 02:45:29.250506 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.250480    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"]
Sep 12 02:45:29.321103 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.321074    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afcf06f8-e763-4d27-b87f-6ebcff429446-apiservice-cert\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.321238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.321107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afcf06f8-e763-4d27-b87f-6ebcff429446-manifests\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.321238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.321138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afcf06f8-e763-4d27-b87f-6ebcff429446-webhook-cert\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.321238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.321200    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6kp9\" (UniqueName: \"kubernetes.io/projected/afcf06f8-e763-4d27-b87f-6ebcff429446-kube-api-access-j6kp9\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.321360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.321246    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afcf06f8-e763-4d27-b87f-6ebcff429446-tmp\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.382421 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.382366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn" event={"ID":"e289c213-280b-4e10-b84a-345da8f0cbd5","Type":"ContainerStarted","Data":"c952f502047b729d3ba6ae858ed8e7439240ed87363350108a2af83db025b076"}
Sep 12 02:45:29.383947 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.383923    2583 generic.go:356] "Generic (PLEG): container finished" podID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerID="d539376eeba7ef9b1cbf70250d7e1958fd021f6afdf50a4cf1c47c58afa34cd9" exitCode=0
Sep 12 02:45:29.384072 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.383990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds" event={"ID":"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb","Type":"ContainerDied","Data":"d539376eeba7ef9b1cbf70250d7e1958fd021f6afdf50a4cf1c47c58afa34cd9"}
Sep 12 02:45:29.384072 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.384033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds" event={"ID":"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb","Type":"ContainerStarted","Data":"b7f2a74ef3faffc0f179f7ef75aa96854de72c33a4c270ed60dc54b1c2f49250"}
Sep 12 02:45:29.422107 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.422078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afcf06f8-e763-4d27-b87f-6ebcff429446-webhook-cert\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.422212 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.422113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6kp9\" (UniqueName: \"kubernetes.io/projected/afcf06f8-e763-4d27-b87f-6ebcff429446-kube-api-access-j6kp9\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.422212 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.422165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afcf06f8-e763-4d27-b87f-6ebcff429446-tmp\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.422341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.422236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afcf06f8-e763-4d27-b87f-6ebcff429446-apiservice-cert\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.422341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.422269    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afcf06f8-e763-4d27-b87f-6ebcff429446-manifests\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.422661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.422643    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/afcf06f8-e763-4d27-b87f-6ebcff429446-manifests\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.424386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.424362    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afcf06f8-e763-4d27-b87f-6ebcff429446-tmp\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.424512 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.424496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/afcf06f8-e763-4d27-b87f-6ebcff429446-webhook-cert\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.424582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.424565    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/afcf06f8-e763-4d27-b87f-6ebcff429446-apiservice-cert\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.432544 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.432525    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6kp9\" (UniqueName: \"kubernetes.io/projected/afcf06f8-e763-4d27-b87f-6ebcff429446-kube-api-access-j6kp9\") pod \"opendatahub-operator-controller-manager-774995dcdd-x5lmw\" (UID: \"afcf06f8-e763-4d27-b87f-6ebcff429446\") " pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.537387 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.537317    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:29.806895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:29.806867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"]
Sep 12 02:45:29.809158 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:45:29.809135    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafcf06f8_e763_4d27_b87f_6ebcff429446.slice/crio-c100450f488070e6b0022c2ed53a76798223a05989ecb1ac9e8a416232704fb7 WatchSource:0}: Error finding container c100450f488070e6b0022c2ed53a76798223a05989ecb1ac9e8a416232704fb7: Status 404 returned error can't find the container with id c100450f488070e6b0022c2ed53a76798223a05989ecb1ac9e8a416232704fb7
Sep 12 02:45:30.394164 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:30.394087    2583 generic.go:356] "Generic (PLEG): container finished" podID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerID="ddeb051164ededb45aa3b825c100ea0c4cc1adbddc970b0b83073066d2f6998e" exitCode=0
Sep 12 02:45:30.394630 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:30.394233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds" event={"ID":"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb","Type":"ContainerDied","Data":"ddeb051164ededb45aa3b825c100ea0c4cc1adbddc970b0b83073066d2f6998e"}
Sep 12 02:45:30.396622 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:30.396599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw" event={"ID":"afcf06f8-e763-4d27-b87f-6ebcff429446","Type":"ContainerStarted","Data":"c100450f488070e6b0022c2ed53a76798223a05989ecb1ac9e8a416232704fb7"}
Sep 12 02:45:31.406260 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:31.406224    2583 generic.go:356] "Generic (PLEG): container finished" podID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerID="87892ede4a986e032790b74442df8f235d0e76f8a2caa1bad8c37f386962efa4" exitCode=0
Sep 12 02:45:31.406860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:31.406293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds" event={"ID":"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb","Type":"ContainerDied","Data":"87892ede4a986e032790b74442df8f235d0e76f8a2caa1bad8c37f386962efa4"}
Sep 12 02:45:32.760332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.760308    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:32.955641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.955601    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvpgm\" (UniqueName: \"kubernetes.io/projected/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-kube-api-access-vvpgm\") pod \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") "
Sep 12 02:45:32.955831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.955695    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-util\") pod \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") "
Sep 12 02:45:32.955831 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.955737    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-bundle\") pod \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\" (UID: \"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb\") "
Sep 12 02:45:32.956481 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.956455    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-bundle" (OuterVolumeSpecName: "bundle") pod "40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" (UID: "40aea107-1eb6-4d4a-a39f-ea95d9a36ceb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:45:32.957721 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.957697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-kube-api-access-vvpgm" (OuterVolumeSpecName: "kube-api-access-vvpgm") pod "40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" (UID: "40aea107-1eb6-4d4a-a39f-ea95d9a36ceb"). InnerVolumeSpecName "kube-api-access-vvpgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:45:32.963281 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:32.963254    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-util" (OuterVolumeSpecName: "util") pod "40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" (UID: "40aea107-1eb6-4d4a-a39f-ea95d9a36ceb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:45:33.057279 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.057209    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvpgm\" (UniqueName: \"kubernetes.io/projected/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-kube-api-access-vvpgm\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:33.057279 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.057234    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:33.057279 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.057244    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/40aea107-1eb6-4d4a-a39f-ea95d9a36ceb-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:45:33.419841 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.419810    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds"
Sep 12 02:45:33.419841 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.419821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kh9ds" event={"ID":"40aea107-1eb6-4d4a-a39f-ea95d9a36ceb","Type":"ContainerDied","Data":"b7f2a74ef3faffc0f179f7ef75aa96854de72c33a4c270ed60dc54b1c2f49250"}
Sep 12 02:45:33.420030 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.419871    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7f2a74ef3faffc0f179f7ef75aa96854de72c33a4c270ed60dc54b1c2f49250"
Sep 12 02:45:33.421540 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:33.421516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw" event={"ID":"afcf06f8-e763-4d27-b87f-6ebcff429446","Type":"ContainerStarted","Data":"b8caec6b214587ccbb3bd360d8b6d79945fe0089aa846193472124acda906c5a"}
Sep 12 02:45:34.427982 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:34.427945    2583 generic.go:356] "Generic (PLEG): container finished" podID="afcf06f8-e763-4d27-b87f-6ebcff429446" containerID="b8caec6b214587ccbb3bd360d8b6d79945fe0089aa846193472124acda906c5a" exitCode=0
Sep 12 02:45:34.428355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:34.427990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw" event={"ID":"afcf06f8-e763-4d27-b87f-6ebcff429446","Type":"ContainerDied","Data":"b8caec6b214587ccbb3bd360d8b6d79945fe0089aa846193472124acda906c5a"}
Sep 12 02:45:35.434924 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:35.434887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw" event={"ID":"afcf06f8-e763-4d27-b87f-6ebcff429446","Type":"ContainerStarted","Data":"bdc7320eda21ac97e127d0f8b94cadf3cb7dfa81cdbdb5726d47b746841b1ad0"}
Sep 12 02:45:35.435393 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:35.434984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:35.457559 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:35.457507    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw" podStartSLOduration=1.93552268 podStartE2EDuration="6.457490588s" totalImagesPullingTime="3.494483391s" totalInitContainerRuntime="1.027484517s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:45:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:45:35.456460532 +0000 UTC m=+567.712441549" watchObservedRunningTime="2026-09-12 02:45:35.457490588 +0000 UTC m=+567.713471603"
Sep 12 02:45:40.460251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:40.460209    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn" event={"ID":"e289c213-280b-4e10-b84a-345da8f0cbd5","Type":"ContainerStarted","Data":"a18d17d0c9f4660a4e4ea142f30dfb0a2a1b2607815746d2106a452f1e1d6847"}
Sep 12 02:45:40.460642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:40.460351    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:40.480629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:40.480584    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn" podStartSLOduration=1.75711916 podStartE2EDuration="12.48056956s" totalImagesPullingTime="10.7234504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:45:40.47856594 +0000 UTC m=+572.734546956" watchObservedRunningTime="2026-09-12 02:45:40.48056956 +0000 UTC m=+572.736550575"
Sep 12 02:45:46.442178 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:46.442145    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-774995dcdd-x5lmw"
Sep 12 02:45:51.467964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:51.467931    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6645c7894d-cmmcn"
Sep 12 02:45:57.720936 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.720907    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"]
Sep 12 02:45:57.721321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721243    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="util"
Sep 12 02:45:57.721321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721255    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="util"
Sep 12 02:45:57.721321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721268    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="extract"
Sep 12 02:45:57.721321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721274    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="extract"
Sep 12 02:45:57.721321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721301    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="pull"
Sep 12 02:45:57.721321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721307    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="pull"
Sep 12 02:45:57.721639 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.721366    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="40aea107-1eb6-4d4a-a39f-ea95d9a36ceb" containerName="extract"
Sep 12 02:45:57.725803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.725784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.728217 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.728192    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 12 02:45:57.728295 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.728218    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xzl5j\""
Sep 12 02:45:57.736316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.736297    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"]
Sep 12 02:45:57.749386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwlcd\" (UniqueName: \"kubernetes.io/projected/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-kube-api-access-qwlcd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749506 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749506 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749447    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749624 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749624 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749729 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749658    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749729 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749707    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749830 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749801    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.749882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.749853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850334 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwlcd\" (UniqueName: \"kubernetes.io/projected/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-kube-api-access-qwlcd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850339    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850402    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850470    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850871 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850782    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850930 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850906    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.850990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.851043 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.850997    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.851279 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.851256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.852752 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.852732    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.852839 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.852735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.858711 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.858690    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:57.858916 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:57.858899    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwlcd\" (UniqueName: \"kubernetes.io/projected/79dfa8e8-2e9c-4f26-b7db-8191b9de51e8-kube-api-access-qwlcd\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp\" (UID: \"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:58.035759 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:58.035685    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:45:58.318663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:58.318635    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"]
Sep 12 02:45:58.320318 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:45:58.320290    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79dfa8e8_2e9c_4f26_b7db_8191b9de51e8.slice/crio-0afe345669b2cc132eeb712de5abcb37e2ca3d316863fbe525301cbee88f8c16 WatchSource:0}: Error finding container 0afe345669b2cc132eeb712de5abcb37e2ca3d316863fbe525301cbee88f8c16: Status 404 returned error can't find the container with id 0afe345669b2cc132eeb712de5abcb37e2ca3d316863fbe525301cbee88f8c16
Sep 12 02:45:58.548518 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:58.548485    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp" event={"ID":"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8","Type":"ContainerStarted","Data":"0afe345669b2cc132eeb712de5abcb37e2ca3d316863fbe525301cbee88f8c16"}
Sep 12 02:45:59.021100 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.021063    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nz4fv"]
Sep 12 02:45:59.024821 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.024796    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.027394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.027192    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 12 02:45:59.027575 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.027553    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-v2qmm\""
Sep 12 02:45:59.031701 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.031681    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nz4fv"]
Sep 12 02:45:59.060307 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.060097    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe87abf-3d80-4125-b1a0-f43772ea61c9-cert\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.060307 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.060166    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw9qp\" (UniqueName: \"kubernetes.io/projected/6fe87abf-3d80-4125-b1a0-f43772ea61c9-kube-api-access-vw9qp\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.161511 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.161463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe87abf-3d80-4125-b1a0-f43772ea61c9-cert\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.161683 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.161527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw9qp\" (UniqueName: \"kubernetes.io/projected/6fe87abf-3d80-4125-b1a0-f43772ea61c9-kube-api-access-vw9qp\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.161959 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:45:59.161915    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 12 02:45:59.162074 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:45:59.161977    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fe87abf-3d80-4125-b1a0-f43772ea61c9-cert podName:6fe87abf-3d80-4125-b1a0-f43772ea61c9 nodeName:}" failed. No retries permitted until 2026-09-12 02:45:59.661959051 +0000 UTC m=+591.917940057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6fe87abf-3d80-4125-b1a0-f43772ea61c9-cert") pod "odh-model-controller-7998c67dc4-nz4fv" (UID: "6fe87abf-3d80-4125-b1a0-f43772ea61c9") : secret "odh-model-controller-webhook-cert" not found
Sep 12 02:45:59.172393 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.172366    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw9qp\" (UniqueName: \"kubernetes.io/projected/6fe87abf-3d80-4125-b1a0-f43772ea61c9-kube-api-access-vw9qp\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.665871 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.665833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe87abf-3d80-4125-b1a0-f43772ea61c9-cert\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.669256 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.669222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6fe87abf-3d80-4125-b1a0-f43772ea61c9-cert\") pod \"odh-model-controller-7998c67dc4-nz4fv\" (UID: \"6fe87abf-3d80-4125-b1a0-f43772ea61c9\") " pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:45:59.940097 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:45:59.940007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:46:00.937992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:00.937956    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:46:00.938326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:00.938031    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:46:00.938326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:00.938059    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:46:01.134475 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:01.134439    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nz4fv"]
Sep 12 02:46:01.136314 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:46:01.136284    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe87abf_3d80_4125_b1a0_f43772ea61c9.slice/crio-9aa844198b7983ce90d89b44f747dbb0462e73129e9c92fafe10af38fbd8c58d WatchSource:0}: Error finding container 9aa844198b7983ce90d89b44f747dbb0462e73129e9c92fafe10af38fbd8c58d: Status 404 returned error can't find the container with id 9aa844198b7983ce90d89b44f747dbb0462e73129e9c92fafe10af38fbd8c58d
Sep 12 02:46:01.565765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:01.565732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv" event={"ID":"6fe87abf-3d80-4125-b1a0-f43772ea61c9","Type":"ContainerStarted","Data":"9aa844198b7983ce90d89b44f747dbb0462e73129e9c92fafe10af38fbd8c58d"}
Sep 12 02:46:01.566969 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:01.566945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp" event={"ID":"79dfa8e8-2e9c-4f26-b7db-8191b9de51e8","Type":"ContainerStarted","Data":"ebef3783fd1b113e75ac21d9ba85368951525c75c73321a1808e57fb8a971793"}
Sep 12 02:46:01.586304 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:01.586261    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp" podStartSLOduration=1.971312877 podStartE2EDuration="4.586247764s" totalImagesPullingTime="2.614934887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:46:01.585950939 +0000 UTC m=+593.841931951" watchObservedRunningTime="2026-09-12 02:46:01.586247764 +0000 UTC m=+593.842228779"
Sep 12 02:46:02.036759 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:02.036673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:46:02.042616 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:02.042582    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:46:02.572442 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:02.572384    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:46:02.573386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:02.573357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp"
Sep 12 02:46:04.584193 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:04.584154    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv" event={"ID":"6fe87abf-3d80-4125-b1a0-f43772ea61c9","Type":"ContainerStarted","Data":"2c440a68693aa747d0a6224ab6b5c505f2c354d136099d681429c74ba21b98f9"}
Sep 12 02:46:04.584584 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:04.584388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:46:04.601931 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:04.601881    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv" podStartSLOduration=2.82120078 podStartE2EDuration="5.601866515s" totalImagesPullingTime="2.780665735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:46:04.600489127 +0000 UTC m=+596.856470141" watchObservedRunningTime="2026-09-12 02:46:04.601866515 +0000 UTC m=+596.857847528"
Sep 12 02:46:05.492543 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.492508    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"]
Sep 12 02:46:05.559922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.559886    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"]
Sep 12 02:46:05.560085 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.559993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.563395 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.563374    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 12 02:46:05.563559 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.563534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 12 02:46:05.563668 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.563534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4vqct\""
Sep 12 02:46:05.564356 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.564339    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 12 02:46:05.625493 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rzhw\" (UniqueName: \"kubernetes.io/projected/14f24ad5-210f-41f2-b3ea-3925a7d2343e-kube-api-access-5rzhw\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.625964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.625964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.625964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.625964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.625964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625657    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.625964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.625702    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f24ad5-210f-41f2-b3ea-3925a7d2343e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726215    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f24ad5-210f-41f2-b3ea-3925a7d2343e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726483 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rzhw\" (UniqueName: \"kubernetes.io/projected/14f24ad5-210f-41f2-b3ea-3925a7d2343e-kube-api-access-5rzhw\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726571 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726571 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726544    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726679 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726572    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726679 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.726679 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.726675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.727418 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.727380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.729243 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.729219    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/14f24ad5-210f-41f2-b3ea-3925a7d2343e-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.729466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.729444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.729554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.729501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.729598 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.729553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/14f24ad5-210f-41f2-b3ea-3925a7d2343e-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.734681 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.734660    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rzhw\" (UniqueName: \"kubernetes.io/projected/14f24ad5-210f-41f2-b3ea-3925a7d2343e-kube-api-access-5rzhw\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.734960 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.734942    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14f24ad5-210f-41f2-b3ea-3925a7d2343e-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dt2dm\" (UID: \"14f24ad5-210f-41f2-b3ea-3925a7d2343e\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:05.869283 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:05.869257    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:06.191585 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:06.191520    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"]
Sep 12 02:46:06.194120 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:46:06.194087    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f24ad5_210f_41f2_b3ea_3925a7d2343e.slice/crio-a0dc48e5ee216038f2bdc72c9e65ff1e6255a3cf3c25370b5dae8f6050bfa93b WatchSource:0}: Error finding container a0dc48e5ee216038f2bdc72c9e65ff1e6255a3cf3c25370b5dae8f6050bfa93b: Status 404 returned error can't find the container with id a0dc48e5ee216038f2bdc72c9e65ff1e6255a3cf3c25370b5dae8f6050bfa93b
Sep 12 02:46:06.595166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:06.595134    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm" event={"ID":"14f24ad5-210f-41f2-b3ea-3925a7d2343e","Type":"ContainerStarted","Data":"a0dc48e5ee216038f2bdc72c9e65ff1e6255a3cf3c25370b5dae8f6050bfa93b"}
Sep 12 02:46:08.492725 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.492696    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:46:08.494974 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.492925    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:46:08.496660 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.496641    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:46:08.496895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.496876    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:46:08.530528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.530498    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:46:08.530602 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.530559    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:46:08.606808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.606777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm" event={"ID":"14f24ad5-210f-41f2-b3ea-3925a7d2343e","Type":"ContainerStarted","Data":"4d38f2a44ce97bf9ef2a231cc395b4bfb738f21784ef7f4f85f8d6d80d5c158c"}
Sep 12 02:46:08.606938 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.606896    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:08.627734 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:08.627687    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm" podStartSLOduration=1.294010377 podStartE2EDuration="3.627673612s" totalImagesPullingTime="2.333663235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:46:08.625752845 +0000 UTC m=+600.881733861" watchObservedRunningTime="2026-09-12 02:46:08.627673612 +0000 UTC m=+600.883654627"
Sep 12 02:46:09.614125 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:09.614095    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dt2dm"
Sep 12 02:46:11.226785 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.226758    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b5555dbf-hxjrf"]
Sep 12 02:46:11.230712 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.230683    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.243683 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.243660    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b5555dbf-hxjrf"]
Sep 12 02:46:11.377085 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377054    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-serving-cert\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.377254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-trusted-ca-bundle\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.377254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377127    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-config\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.377254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-oauth-serving-cert\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.377254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-oauth-config\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.377254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-service-ca\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.377579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.377262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqpws\" (UniqueName: \"kubernetes.io/projected/654b4917-2bbd-4230-ada9-0b3ce80db2e3-kube-api-access-fqpws\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478529 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-oauth-serving-cert\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478529 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478493    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-oauth-config\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478529 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478517    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-service-ca\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478540    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqpws\" (UniqueName: \"kubernetes.io/projected/654b4917-2bbd-4230-ada9-0b3ce80db2e3-kube-api-access-fqpws\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478589    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-serving-cert\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-trusted-ca-bundle\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.478791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.478707    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-config\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.479270 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.479247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-oauth-serving-cert\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.479469 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.479335    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-config\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.479469 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.479457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-service-ca\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.479611 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.479588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/654b4917-2bbd-4230-ada9-0b3ce80db2e3-trusted-ca-bundle\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.481094 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.481068    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-serving-cert\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.481177 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.481095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/654b4917-2bbd-4230-ada9-0b3ce80db2e3-console-oauth-config\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.486384 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.486365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqpws\" (UniqueName: \"kubernetes.io/projected/654b4917-2bbd-4230-ada9-0b3ce80db2e3-kube-api-access-fqpws\") pod \"console-9b5555dbf-hxjrf\" (UID: \"654b4917-2bbd-4230-ada9-0b3ce80db2e3\") " pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.540487 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.540464    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:11.815180 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:11.815152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b5555dbf-hxjrf"]
Sep 12 02:46:11.818537 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:46:11.818512    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654b4917_2bbd_4230_ada9_0b3ce80db2e3.slice/crio-a02638e8d8c649f7e57d8d35f7bdfd1aadcb3bed126bcf34c5436e95f755f25c WatchSource:0}: Error finding container a02638e8d8c649f7e57d8d35f7bdfd1aadcb3bed126bcf34c5436e95f755f25c: Status 404 returned error can't find the container with id a02638e8d8c649f7e57d8d35f7bdfd1aadcb3bed126bcf34c5436e95f755f25c
Sep 12 02:46:12.630475 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:12.630439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b5555dbf-hxjrf" event={"ID":"654b4917-2bbd-4230-ada9-0b3ce80db2e3","Type":"ContainerStarted","Data":"2ae509d7303d4c89be1d7f0900f3d581b216ab7a8444b852d474a78b475adb40"}
Sep 12 02:46:12.630877 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:12.630493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b5555dbf-hxjrf" event={"ID":"654b4917-2bbd-4230-ada9-0b3ce80db2e3","Type":"ContainerStarted","Data":"a02638e8d8c649f7e57d8d35f7bdfd1aadcb3bed126bcf34c5436e95f755f25c"}
Sep 12 02:46:12.651038 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:12.650991    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b5555dbf-hxjrf" podStartSLOduration=1.650976838 podStartE2EDuration="1.650976838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:46:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:46:12.649498514 +0000 UTC m=+604.905479531" watchObservedRunningTime="2026-09-12 02:46:12.650976838 +0000 UTC m=+604.906957853"
Sep 12 02:46:15.591488 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:15.591455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nz4fv"
Sep 12 02:46:21.540862 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:21.540830    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:21.541265 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:21.540909    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:21.545339 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:21.545318    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:21.678554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:21.678528    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9b5555dbf-hxjrf"
Sep 12 02:46:21.722685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:21.722655    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d886c747f-zstb7"]
Sep 12 02:46:46.743740 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:46.743636    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d886c747f-zstb7" podUID="f3b33740-b9ed-407d-b7eb-d9078c1a321d" containerName="console" containerID="cri-o://14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0" gracePeriod=15
Sep 12 02:46:46.988923 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:46.988896    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:46:47.078457 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-serving-cert\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078481    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-oauth-serving-cert\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078524    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-trusted-ca-bundle\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078543    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-service-ca\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078567    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-config\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078881 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078599    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz5m4\" (UniqueName: \"kubernetes.io/projected/f3b33740-b9ed-407d-b7eb-d9078c1a321d-kube-api-access-jz5m4\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078881 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078645    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-oauth-config\") pod \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\" (UID: \"f3b33740-b9ed-407d-b7eb-d9078c1a321d\") "
Sep 12 02:46:47.078988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.078963    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-service-ca" (OuterVolumeSpecName: "service-ca") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:46:47.079046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.079013    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:46:47.079046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.079024    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:46:47.079118 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.079067    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-config" (OuterVolumeSpecName: "console-config") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:46:47.080823 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.080792    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:46:47.080823 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.080807    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b33740-b9ed-407d-b7eb-d9078c1a321d-kube-api-access-jz5m4" (OuterVolumeSpecName: "kube-api-access-jz5m4") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "kube-api-access-jz5m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:46:47.081006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.080855    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f3b33740-b9ed-407d-b7eb-d9078c1a321d" (UID: "f3b33740-b9ed-407d-b7eb-d9078c1a321d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 12 02:46:47.179466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179439    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.179466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179461    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-oauth-serving-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.179466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179471    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-trusted-ca-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.179641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179480    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.179641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179490    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.179641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179497    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz5m4\" (UniqueName: \"kubernetes.io/projected/f3b33740-b9ed-407d-b7eb-d9078c1a321d-kube-api-access-jz5m4\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.179641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.179505    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f3b33740-b9ed-407d-b7eb-d9078c1a321d-console-oauth-config\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:46:47.802593 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.802560    2583 generic.go:356] "Generic (PLEG): container finished" podID="f3b33740-b9ed-407d-b7eb-d9078c1a321d" containerID="14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0" exitCode=0
Sep 12 02:46:47.802981 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.802606    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d886c747f-zstb7"
Sep 12 02:46:47.802981 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.802638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d886c747f-zstb7" event={"ID":"f3b33740-b9ed-407d-b7eb-d9078c1a321d","Type":"ContainerDied","Data":"14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0"}
Sep 12 02:46:47.802981 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.802703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d886c747f-zstb7" event={"ID":"f3b33740-b9ed-407d-b7eb-d9078c1a321d","Type":"ContainerDied","Data":"74bf137896af315e232c1094fdf287180488cfc3ae17392c9e63cf9c65d21f81"}
Sep 12 02:46:47.802981 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.802730    2583 scope.go:117] "RemoveContainer" containerID="14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0"
Sep 12 02:46:47.812278 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.812261    2583 scope.go:117] "RemoveContainer" containerID="14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0"
Sep 12 02:46:47.812545 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:46:47.812527    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0\": container with ID starting with 14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0 not found: ID does not exist" containerID="14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0"
Sep 12 02:46:47.812610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.812556    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0"} err="failed to get container status \"14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0\": rpc error: code = NotFound desc = could not find container \"14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0\": container with ID starting with 14592930ddd90730764f8b72be09de98290ffacc514170ab8fa268c91539b8b0 not found: ID does not exist"
Sep 12 02:46:47.823977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.823953    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d886c747f-zstb7"]
Sep 12 02:46:47.827204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:47.827185    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d886c747f-zstb7"]
Sep 12 02:46:48.166985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:46:48.166946    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b33740-b9ed-407d-b7eb-d9078c1a321d" path="/var/lib/kubelet/pods/f3b33740-b9ed-407d-b7eb-d9078c1a321d/volumes"
Sep 12 02:47:03.728890 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.728849    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"]
Sep 12 02:47:03.729392 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.729370    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3b33740-b9ed-407d-b7eb-d9078c1a321d" containerName="console"
Sep 12 02:47:03.729392 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.729390    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3b33740-b9ed-407d-b7eb-d9078c1a321d" containerName="console"
Sep 12 02:47:03.729577 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.729562    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3b33740-b9ed-407d-b7eb-d9078c1a321d" containerName="console"
Sep 12 02:47:03.732636 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.732613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.734947 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.734923    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 12 02:47:03.735814 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.735790    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c7z8z\""
Sep 12 02:47:03.735932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.735799    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 12 02:47:03.739787 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.739754    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"]
Sep 12 02:47:03.826551 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.826514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.826862 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.826834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wm2x\" (UniqueName: \"kubernetes.io/projected/eb24d492-44fb-4029-b79f-cdd3914e0e47-kube-api-access-7wm2x\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.827069 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.827049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.829001 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.828968    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"]
Sep 12 02:47:03.835141 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.835126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:03.841395 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.841371    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"]
Sep 12 02:47:03.928285 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928250    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.928563 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkqw\" (UniqueName: \"kubernetes.io/projected/234ee143-67ed-43a2-9323-1d268e4d9b03-kube-api-access-rwkqw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:03.928669 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.928669 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wm2x\" (UniqueName: \"kubernetes.io/projected/eb24d492-44fb-4029-b79f-cdd3914e0e47-kube-api-access-7wm2x\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.928787 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:03.928787 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928711    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.928787 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:03.928953 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.928926    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.930754 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.930732    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"]
Sep 12 02:47:03.934523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.934507    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:03.936220 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.936196    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wm2x\" (UniqueName: \"kubernetes.io/projected/eb24d492-44fb-4029-b79f-cdd3914e0e47-kube-api-access-7wm2x\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:03.941928 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:03.941904    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"]
Sep 12 02:47:04.029528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkqw\" (UniqueName: \"kubernetes.io/projected/234ee143-67ed-43a2-9323-1d268e4d9b03-kube-api-access-rwkqw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.029528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.029749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.029749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.029749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfp8m\" (UniqueName: \"kubernetes.io/projected/e9888763-b86c-47e7-8dea-a7b3beb612f4-kube-api-access-kfp8m\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.029749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.029945 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029926    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.029988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.029945    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.035484 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.035459    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"]
Sep 12 02:47:04.037803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.037780    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkqw\" (UniqueName: \"kubernetes.io/projected/234ee143-67ed-43a2-9323-1d268e4d9b03-kube-api-access-rwkqw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.038895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.038880    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.043394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.043369    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:04.046352 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.046248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"]
Sep 12 02:47:04.130177 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130145    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.130360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130182    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.130360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130228    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sm2p\" (UniqueName: \"kubernetes.io/projected/6eb354a3-d0f7-4a7f-b931-796e836093e8-kube-api-access-6sm2p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.130360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130246    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.130360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfp8m\" (UniqueName: \"kubernetes.io/projected/e9888763-b86c-47e7-8dea-a7b3beb612f4-kube-api-access-kfp8m\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.130360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130353    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.130746 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.130746 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.130634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.138901 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.138872    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfp8m\" (UniqueName: \"kubernetes.io/projected/e9888763-b86c-47e7-8dea-a7b3beb612f4-kube-api-access-kfp8m\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.145556 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.145533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:04.231339 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.231304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sm2p\" (UniqueName: \"kubernetes.io/projected/6eb354a3-d0f7-4a7f-b931-796e836093e8-kube-api-access-6sm2p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.231532 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.231424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.231598 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.231581    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.231860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.231838    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.231943 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.231927    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.240065 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.240041    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sm2p\" (UniqueName: \"kubernetes.io/projected/6eb354a3-d0f7-4a7f-b931-796e836093e8-kube-api-access-6sm2p\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.252765 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.252747    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:04.319003 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.318973    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"]
Sep 12 02:47:04.320969 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:47:04.320947    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb24d492_44fb_4029_b79f_cdd3914e0e47.slice/crio-8bc6e7eed6f37a74bdda25a494b2089a08141def6883e85aa65cda9cad7685ca WatchSource:0}: Error finding container 8bc6e7eed6f37a74bdda25a494b2089a08141def6883e85aa65cda9cad7685ca: Status 404 returned error can't find the container with id 8bc6e7eed6f37a74bdda25a494b2089a08141def6883e85aa65cda9cad7685ca
Sep 12 02:47:04.373873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.373848    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:04.419120 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.419088    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"]
Sep 12 02:47:04.421522 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:47:04.421488    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234ee143_67ed_43a2_9323_1d268e4d9b03.slice/crio-6d1825f3eb2848785e93fbbc9be9abed5d9cebc0283bf7d0364af968bbdac6ae WatchSource:0}: Error finding container 6d1825f3eb2848785e93fbbc9be9abed5d9cebc0283bf7d0364af968bbdac6ae: Status 404 returned error can't find the container with id 6d1825f3eb2848785e93fbbc9be9abed5d9cebc0283bf7d0364af968bbdac6ae
Sep 12 02:47:04.525610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.525583    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"]
Sep 12 02:47:04.527721 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:47:04.527692    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9888763_b86c_47e7_8dea_a7b3beb612f4.slice/crio-258be2ea3ad296c72fd4aa498da76a77d0d3644fb6aa4f70ce8bacfc5cbd7dda WatchSource:0}: Error finding container 258be2ea3ad296c72fd4aa498da76a77d0d3644fb6aa4f70ce8bacfc5cbd7dda: Status 404 returned error can't find the container with id 258be2ea3ad296c72fd4aa498da76a77d0d3644fb6aa4f70ce8bacfc5cbd7dda
Sep 12 02:47:04.650764 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:47:04.650736    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eb354a3_d0f7_4a7f_b931_796e836093e8.slice/crio-d0a521df2afc4233c1c2432d94eff22917f8353b773623d1728461b62b6c34e6 WatchSource:0}: Error finding container d0a521df2afc4233c1c2432d94eff22917f8353b773623d1728461b62b6c34e6: Status 404 returned error can't find the container with id d0a521df2afc4233c1c2432d94eff22917f8353b773623d1728461b62b6c34e6
Sep 12 02:47:04.666663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.666638    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"]
Sep 12 02:47:04.888510 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.888399    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerID="a75f6b97be7b5db7da0bedac427f649d2e48c5ffa0dd069fe8a7efa32138cdef" exitCode=0
Sep 12 02:47:04.888510 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.888495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7" event={"ID":"e9888763-b86c-47e7-8dea-a7b3beb612f4","Type":"ContainerDied","Data":"a75f6b97be7b5db7da0bedac427f649d2e48c5ffa0dd069fe8a7efa32138cdef"}
Sep 12 02:47:04.888975 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.888553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7" event={"ID":"e9888763-b86c-47e7-8dea-a7b3beb612f4","Type":"ContainerStarted","Data":"258be2ea3ad296c72fd4aa498da76a77d0d3644fb6aa4f70ce8bacfc5cbd7dda"}
Sep 12 02:47:04.889739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.889719    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 02:47:04.890210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.890184    2583 generic.go:356] "Generic (PLEG): container finished" podID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerID="d0dded829ff96cdc3e91097aec8927659a3b415616e069578f8f6aa36cda34ed" exitCode=0
Sep 12 02:47:04.890309 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.890286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t" event={"ID":"6eb354a3-d0f7-4a7f-b931-796e836093e8","Type":"ContainerDied","Data":"d0dded829ff96cdc3e91097aec8927659a3b415616e069578f8f6aa36cda34ed"}
Sep 12 02:47:04.890634 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.890336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t" event={"ID":"6eb354a3-d0f7-4a7f-b931-796e836093e8","Type":"ContainerStarted","Data":"d0a521df2afc4233c1c2432d94eff22917f8353b773623d1728461b62b6c34e6"}
Sep 12 02:47:04.892197 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.892175    2583 generic.go:356] "Generic (PLEG): container finished" podID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerID="967551159e9138793ad8058d77d2892f04e43f3be1528b346ccd4ce395d5aec6" exitCode=0
Sep 12 02:47:04.892310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.892258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc" event={"ID":"eb24d492-44fb-4029-b79f-cdd3914e0e47","Type":"ContainerDied","Data":"967551159e9138793ad8058d77d2892f04e43f3be1528b346ccd4ce395d5aec6"}
Sep 12 02:47:04.892310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.892293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc" event={"ID":"eb24d492-44fb-4029-b79f-cdd3914e0e47","Type":"ContainerStarted","Data":"8bc6e7eed6f37a74bdda25a494b2089a08141def6883e85aa65cda9cad7685ca"}
Sep 12 02:47:04.894263 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.894114    2583 generic.go:356] "Generic (PLEG): container finished" podID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerID="4368cb830d768ce6bee4e9c76cebee92064afb6314802e7a7dc7b01139917279" exitCode=0
Sep 12 02:47:04.894263 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.894139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k" event={"ID":"234ee143-67ed-43a2-9323-1d268e4d9b03","Type":"ContainerDied","Data":"4368cb830d768ce6bee4e9c76cebee92064afb6314802e7a7dc7b01139917279"}
Sep 12 02:47:04.894263 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:04.894183    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k" event={"ID":"234ee143-67ed-43a2-9323-1d268e4d9b03","Type":"ContainerStarted","Data":"6d1825f3eb2848785e93fbbc9be9abed5d9cebc0283bf7d0364af968bbdac6ae"}
Sep 12 02:47:06.908979 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.908944    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerID="8e2fbd62d7ec92373a31216fba5c4343ae04a3e4f2e976c7123749b1c01bbb8e" exitCode=0
Sep 12 02:47:06.909419 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.909026    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7" event={"ID":"e9888763-b86c-47e7-8dea-a7b3beb612f4","Type":"ContainerDied","Data":"8e2fbd62d7ec92373a31216fba5c4343ae04a3e4f2e976c7123749b1c01bbb8e"}
Sep 12 02:47:06.911138 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.911119    2583 generic.go:356] "Generic (PLEG): container finished" podID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerID="7490b1c46ae1ac917679731363e8ebdd2b586b51ddc4e31ca20e42786272b021" exitCode=0
Sep 12 02:47:06.911238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.911186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t" event={"ID":"6eb354a3-d0f7-4a7f-b931-796e836093e8","Type":"ContainerDied","Data":"7490b1c46ae1ac917679731363e8ebdd2b586b51ddc4e31ca20e42786272b021"}
Sep 12 02:47:06.913163 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.913142    2583 generic.go:356] "Generic (PLEG): container finished" podID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerID="064ebaec7774593d4ebe6b0d343332a104153df28d013aa84bd40e3f827cb2fc" exitCode=0
Sep 12 02:47:06.913251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.913215    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc" event={"ID":"eb24d492-44fb-4029-b79f-cdd3914e0e47","Type":"ContainerDied","Data":"064ebaec7774593d4ebe6b0d343332a104153df28d013aa84bd40e3f827cb2fc"}
Sep 12 02:47:06.915366 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.915346    2583 generic.go:356] "Generic (PLEG): container finished" podID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerID="cbac3ea370518f734a45c6ffd3638806d17b2514940dc8446cc4ec5655509c55" exitCode=0
Sep 12 02:47:06.915479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:06.915422    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k" event={"ID":"234ee143-67ed-43a2-9323-1d268e4d9b03","Type":"ContainerDied","Data":"cbac3ea370518f734a45c6ffd3638806d17b2514940dc8446cc4ec5655509c55"}
Sep 12 02:47:07.252817 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:47:07.252770    2583 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9888763_b86c_47e7_8dea_a7b3beb612f4.slice/crio-e6ce6ae787f2a07fdc26238a42eb567ffc233b86e8f0d0eb38ad0c27968bbecf.scope\": RecentStats: unable to find data in memory cache]"
Sep 12 02:47:07.922857 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.922822    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerID="e6ce6ae787f2a07fdc26238a42eb567ffc233b86e8f0d0eb38ad0c27968bbecf" exitCode=0
Sep 12 02:47:07.923246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.922901    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7" event={"ID":"e9888763-b86c-47e7-8dea-a7b3beb612f4","Type":"ContainerDied","Data":"e6ce6ae787f2a07fdc26238a42eb567ffc233b86e8f0d0eb38ad0c27968bbecf"}
Sep 12 02:47:07.925029 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.925008    2583 generic.go:356] "Generic (PLEG): container finished" podID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerID="3a6deaf5c8fa54521c9f923ce8714dad3cccfe9289ac4b207aa8ffbe45e4cf2b" exitCode=0
Sep 12 02:47:07.925106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.925086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t" event={"ID":"6eb354a3-d0f7-4a7f-b931-796e836093e8","Type":"ContainerDied","Data":"3a6deaf5c8fa54521c9f923ce8714dad3cccfe9289ac4b207aa8ffbe45e4cf2b"}
Sep 12 02:47:07.927195 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.927171    2583 generic.go:356] "Generic (PLEG): container finished" podID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerID="ac3bc69953bc9a77006eeeb2585c9b8deea6d9aa98591a4806526ebaa29070d7" exitCode=0
Sep 12 02:47:07.927311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.927246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc" event={"ID":"eb24d492-44fb-4029-b79f-cdd3914e0e47","Type":"ContainerDied","Data":"ac3bc69953bc9a77006eeeb2585c9b8deea6d9aa98591a4806526ebaa29070d7"}
Sep 12 02:47:07.929322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.929302    2583 generic.go:356] "Generic (PLEG): container finished" podID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerID="3769c2928ddae255b46cd4e9e79e5a4bf7e245b388b4c012bb4a44f73e14013b" exitCode=0
Sep 12 02:47:07.929427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:07.929343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k" event={"ID":"234ee143-67ed-43a2-9323-1d268e4d9b03","Type":"ContainerDied","Data":"3769c2928ddae255b46cd4e9e79e5a4bf7e245b388b4c012bb4a44f73e14013b"}
Sep 12 02:47:09.093163 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.093130    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:47:09.138394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.138371    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:09.141898 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.141874    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:09.145522 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.145502    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:09.183629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.183603    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-bundle\") pod \"e9888763-b86c-47e7-8dea-a7b3beb612f4\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") "
Sep 12 02:47:09.183794 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.183707    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfp8m\" (UniqueName: \"kubernetes.io/projected/e9888763-b86c-47e7-8dea-a7b3beb612f4-kube-api-access-kfp8m\") pod \"e9888763-b86c-47e7-8dea-a7b3beb612f4\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") "
Sep 12 02:47:09.183794 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.183741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-util\") pod \"e9888763-b86c-47e7-8dea-a7b3beb612f4\" (UID: \"e9888763-b86c-47e7-8dea-a7b3beb612f4\") "
Sep 12 02:47:09.184164 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.184139    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-bundle" (OuterVolumeSpecName: "bundle") pod "e9888763-b86c-47e7-8dea-a7b3beb612f4" (UID: "e9888763-b86c-47e7-8dea-a7b3beb612f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.186015 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.185941    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9888763-b86c-47e7-8dea-a7b3beb612f4-kube-api-access-kfp8m" (OuterVolumeSpecName: "kube-api-access-kfp8m") pod "e9888763-b86c-47e7-8dea-a7b3beb612f4" (UID: "e9888763-b86c-47e7-8dea-a7b3beb612f4"). InnerVolumeSpecName "kube-api-access-kfp8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:47:09.189735 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.189707    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-util" (OuterVolumeSpecName: "util") pod "e9888763-b86c-47e7-8dea-a7b3beb612f4" (UID: "e9888763-b86c-47e7-8dea-a7b3beb612f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.284838 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.284808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-util\") pod \"6eb354a3-d0f7-4a7f-b931-796e836093e8\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") "
Sep 12 02:47:09.285033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.284850    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-util\") pod \"234ee143-67ed-43a2-9323-1d268e4d9b03\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") "
Sep 12 02:47:09.285033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.284881    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sm2p\" (UniqueName: \"kubernetes.io/projected/6eb354a3-d0f7-4a7f-b931-796e836093e8-kube-api-access-6sm2p\") pod \"6eb354a3-d0f7-4a7f-b931-796e836093e8\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") "
Sep 12 02:47:09.285033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.284911    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-bundle\") pod \"eb24d492-44fb-4029-b79f-cdd3914e0e47\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") "
Sep 12 02:47:09.285033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.284971    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwkqw\" (UniqueName: \"kubernetes.io/projected/234ee143-67ed-43a2-9323-1d268e4d9b03-kube-api-access-rwkqw\") pod \"234ee143-67ed-43a2-9323-1d268e4d9b03\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") "
Sep 12 02:47:09.285033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.285030    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-util\") pod \"eb24d492-44fb-4029-b79f-cdd3914e0e47\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") "
Sep 12 02:47:09.285592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.285564    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-bundle" (OuterVolumeSpecName: "bundle") pod "eb24d492-44fb-4029-b79f-cdd3914e0e47" (UID: "eb24d492-44fb-4029-b79f-cdd3914e0e47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.285745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.285719    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wm2x\" (UniqueName: \"kubernetes.io/projected/eb24d492-44fb-4029-b79f-cdd3914e0e47-kube-api-access-7wm2x\") pod \"eb24d492-44fb-4029-b79f-cdd3914e0e47\" (UID: \"eb24d492-44fb-4029-b79f-cdd3914e0e47\") "
Sep 12 02:47:09.285964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.285849    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-bundle\") pod \"234ee143-67ed-43a2-9323-1d268e4d9b03\" (UID: \"234ee143-67ed-43a2-9323-1d268e4d9b03\") "
Sep 12 02:47:09.285964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.285884    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-bundle\") pod \"6eb354a3-d0f7-4a7f-b931-796e836093e8\" (UID: \"6eb354a3-d0f7-4a7f-b931-796e836093e8\") "
Sep 12 02:47:09.286220 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.286207    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.286311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.286252    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.286311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.286267    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfp8m\" (UniqueName: \"kubernetes.io/projected/e9888763-b86c-47e7-8dea-a7b3beb612f4-kube-api-access-kfp8m\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.286311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.286281    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9888763-b86c-47e7-8dea-a7b3beb612f4-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.286495 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.286316    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-bundle" (OuterVolumeSpecName: "bundle") pod "234ee143-67ed-43a2-9323-1d268e4d9b03" (UID: "234ee143-67ed-43a2-9323-1d268e4d9b03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.287023 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.286988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-bundle" (OuterVolumeSpecName: "bundle") pod "6eb354a3-d0f7-4a7f-b931-796e836093e8" (UID: "6eb354a3-d0f7-4a7f-b931-796e836093e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.287677 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.287644    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb24d492-44fb-4029-b79f-cdd3914e0e47-kube-api-access-7wm2x" (OuterVolumeSpecName: "kube-api-access-7wm2x") pod "eb24d492-44fb-4029-b79f-cdd3914e0e47" (UID: "eb24d492-44fb-4029-b79f-cdd3914e0e47"). InnerVolumeSpecName "kube-api-access-7wm2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:47:09.287755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.287723    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/234ee143-67ed-43a2-9323-1d268e4d9b03-kube-api-access-rwkqw" (OuterVolumeSpecName: "kube-api-access-rwkqw") pod "234ee143-67ed-43a2-9323-1d268e4d9b03" (UID: "234ee143-67ed-43a2-9323-1d268e4d9b03"). InnerVolumeSpecName "kube-api-access-rwkqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:47:09.287941 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.287923    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eb354a3-d0f7-4a7f-b931-796e836093e8-kube-api-access-6sm2p" (OuterVolumeSpecName: "kube-api-access-6sm2p") pod "6eb354a3-d0f7-4a7f-b931-796e836093e8" (UID: "6eb354a3-d0f7-4a7f-b931-796e836093e8"). InnerVolumeSpecName "kube-api-access-6sm2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:47:09.290551 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.290530    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-util" (OuterVolumeSpecName: "util") pod "234ee143-67ed-43a2-9323-1d268e4d9b03" (UID: "234ee143-67ed-43a2-9323-1d268e4d9b03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.293676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.293644    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-util" (OuterVolumeSpecName: "util") pod "eb24d492-44fb-4029-b79f-cdd3914e0e47" (UID: "eb24d492-44fb-4029-b79f-cdd3914e0e47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.293828 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.293810    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-util" (OuterVolumeSpecName: "util") pod "6eb354a3-d0f7-4a7f-b931-796e836093e8" (UID: "6eb354a3-d0f7-4a7f-b931-796e836093e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:47:09.387591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387555    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwkqw\" (UniqueName: \"kubernetes.io/projected/234ee143-67ed-43a2-9323-1d268e4d9b03-kube-api-access-rwkqw\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387584    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb24d492-44fb-4029-b79f-cdd3914e0e47-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387596    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wm2x\" (UniqueName: \"kubernetes.io/projected/eb24d492-44fb-4029-b79f-cdd3914e0e47-kube-api-access-7wm2x\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387813 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387606    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387813 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387614    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-bundle\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387813 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387622    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6eb354a3-d0f7-4a7f-b931-796e836093e8-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387813 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387629    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/234ee143-67ed-43a2-9323-1d268e4d9b03-util\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.387813 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.387638    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sm2p\" (UniqueName: \"kubernetes.io/projected/6eb354a3-d0f7-4a7f-b931-796e836093e8-kube-api-access-6sm2p\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:47:09.942639 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.942603    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t" event={"ID":"6eb354a3-d0f7-4a7f-b931-796e836093e8","Type":"ContainerDied","Data":"d0a521df2afc4233c1c2432d94eff22917f8353b773623d1728461b62b6c34e6"}
Sep 12 02:47:09.942846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.942651    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0a521df2afc4233c1c2432d94eff22917f8353b773623d1728461b62b6c34e6"
Sep 12 02:47:09.942846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.942618    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8tn6t"
Sep 12 02:47:09.944671 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.944649    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc"
Sep 12 02:47:09.944799 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.944677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c54bgc" event={"ID":"eb24d492-44fb-4029-b79f-cdd3914e0e47","Type":"ContainerDied","Data":"8bc6e7eed6f37a74bdda25a494b2089a08141def6883e85aa65cda9cad7685ca"}
Sep 12 02:47:09.944799 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.944718    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bc6e7eed6f37a74bdda25a494b2089a08141def6883e85aa65cda9cad7685ca"
Sep 12 02:47:09.946845 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.946826    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k"
Sep 12 02:47:09.946976 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.946859    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c66v54k" event={"ID":"234ee143-67ed-43a2-9323-1d268e4d9b03","Type":"ContainerDied","Data":"6d1825f3eb2848785e93fbbc9be9abed5d9cebc0283bf7d0364af968bbdac6ae"}
Sep 12 02:47:09.946976 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.946898    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d1825f3eb2848785e93fbbc9be9abed5d9cebc0283bf7d0364af968bbdac6ae"
Sep 12 02:47:09.949108 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.949081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7" event={"ID":"e9888763-b86c-47e7-8dea-a7b3beb612f4","Type":"ContainerDied","Data":"258be2ea3ad296c72fd4aa498da76a77d0d3644fb6aa4f70ce8bacfc5cbd7dda"}
Sep 12 02:47:09.949222 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.949124    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="258be2ea3ad296c72fd4aa498da76a77d0d3644fb6aa4f70ce8bacfc5cbd7dda"
Sep 12 02:47:09.949222 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:47:09.949136    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7s9bg7"
Sep 12 02:49:34.285591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285500    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"]
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285853    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285865    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285875    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285880    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285888    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285894    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285904    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285910    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285917    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285922    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285933    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285938    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285944    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285950    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285967    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285972    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="extract"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285978    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285983    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285989    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285993    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="util"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.285999    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286003    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286010    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="pull"
Sep 12 02:49:34.286011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286014    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="pull"
Sep 12 02:49:34.286802 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286067    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eb354a3-d0f7-4a7f-b931-796e836093e8" containerName="extract"
Sep 12 02:49:34.286802 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286075    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="234ee143-67ed-43a2-9323-1d268e4d9b03" containerName="extract"
Sep 12 02:49:34.286802 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286084    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9888763-b86c-47e7-8dea-a7b3beb612f4" containerName="extract"
Sep 12 02:49:34.286802 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.286089    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb24d492-44fb-4029-b79f-cdd3914e0e47" containerName="extract"
Sep 12 02:49:34.288977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.288961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.291176 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.291158    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v6nz2\""
Sep 12 02:49:34.291290 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.291197    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 12 02:49:34.299320 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.299295    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"]
Sep 12 02:49:34.434196 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.434167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cznmq\" (UniqueName: \"kubernetes.io/projected/15b83b5a-6126-463d-ae98-3ea42c988d51-kube-api-access-cznmq\") pod \"payload-pre-processing-59fbc47bf8-9n6nk\" (UID: \"15b83b5a-6126-463d-ae98-3ea42c988d51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.434341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.434235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15b83b5a-6126-463d-ae98-3ea42c988d51-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9n6nk\" (UID: \"15b83b5a-6126-463d-ae98-3ea42c988d51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.535342 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.535308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15b83b5a-6126-463d-ae98-3ea42c988d51-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9n6nk\" (UID: \"15b83b5a-6126-463d-ae98-3ea42c988d51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.535541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.535383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cznmq\" (UniqueName: \"kubernetes.io/projected/15b83b5a-6126-463d-ae98-3ea42c988d51-kube-api-access-cznmq\") pod \"payload-pre-processing-59fbc47bf8-9n6nk\" (UID: \"15b83b5a-6126-463d-ae98-3ea42c988d51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.536021 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.535971    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15b83b5a-6126-463d-ae98-3ea42c988d51-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-9n6nk\" (UID: \"15b83b5a-6126-463d-ae98-3ea42c988d51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.542808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.542776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cznmq\" (UniqueName: \"kubernetes.io/projected/15b83b5a-6126-463d-ae98-3ea42c988d51-kube-api-access-cznmq\") pod \"payload-pre-processing-59fbc47bf8-9n6nk\" (UID: \"15b83b5a-6126-463d-ae98-3ea42c988d51\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.599941 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.599919    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:34.868601 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:34.868578    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"]
Sep 12 02:49:34.870108 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:49:34.870080    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b83b5a_6126_463d_ae98_3ea42c988d51.slice/crio-5d3c2a4d3756a5d0479c483508da972e1f13aee1bf71cfee638e235476999177 WatchSource:0}: Error finding container 5d3c2a4d3756a5d0479c483508da972e1f13aee1bf71cfee638e235476999177: Status 404 returned error can't find the container with id 5d3c2a4d3756a5d0479c483508da972e1f13aee1bf71cfee638e235476999177
Sep 12 02:49:35.698420 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:35.698369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk" event={"ID":"15b83b5a-6126-463d-ae98-3ea42c988d51","Type":"ContainerStarted","Data":"5d3c2a4d3756a5d0479c483508da972e1f13aee1bf71cfee638e235476999177"}
Sep 12 02:49:36.705904 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:36.705816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk" event={"ID":"15b83b5a-6126-463d-ae98-3ea42c988d51","Type":"ContainerStarted","Data":"aa5c14b60c41e068c4b4e634a8f9742030c5768f746f257b8281242e074dd56d"}
Sep 12 02:49:36.706234 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:36.705905    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:36.721797 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:36.721753    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk" podStartSLOduration=1.269147657 podStartE2EDuration="2.721739687s" totalImagesPullingTime="1.45259203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:49:36.720262599 +0000 UTC m=+808.976243646" watchObservedRunningTime="2026-09-12 02:49:36.721739687 +0000 UTC m=+808.977720701"
Sep 12 02:49:47.713298 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:47.713266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-9n6nk"
Sep 12 02:49:54.723386 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.723352    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"]
Sep 12 02:49:54.727037 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.727016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.729393 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.729372    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 12 02:49:54.729530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.729399    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 12 02:49:54.730217 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.730197    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wxtgp\""
Sep 12 02:49:54.730331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.730314    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 12 02:49:54.736769 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.736748    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"]
Sep 12 02:49:54.813709 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.813676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.813864 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.813734    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c99f42c-207f-4e38-ab4e-448199b5ba9f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.813864 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.813798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwq7d\" (UniqueName: \"kubernetes.io/projected/8c99f42c-207f-4e38-ab4e-448199b5ba9f-kube-api-access-nwq7d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.813864 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.813845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.813977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.813865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.813977 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.813904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.914940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.914898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.914957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.914985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.915040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c99f42c-207f-4e38-ab4e-448199b5ba9f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915106 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.915077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwq7d\" (UniqueName: \"kubernetes.io/projected/8c99f42c-207f-4e38-ab4e-448199b5ba9f-kube-api-access-nwq7d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915314 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.915114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915314 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.915287    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915451 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.915309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.915451 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.915372    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.917276 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.917245    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c99f42c-207f-4e38-ab4e-448199b5ba9f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.917524 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.917508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c99f42c-207f-4e38-ab4e-448199b5ba9f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:54.922507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:54.922480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwq7d\" (UniqueName: \"kubernetes.io/projected/8c99f42c-207f-4e38-ab4e-448199b5ba9f-kube-api-access-nwq7d\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng\" (UID: \"8c99f42c-207f-4e38-ab4e-448199b5ba9f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:55.038966 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:55.038898    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:49:55.308153 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:55.308125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"]
Sep 12 02:49:55.309399 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:49:55.309371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c99f42c_207f_4e38_ab4e_448199b5ba9f.slice/crio-d3c7ff156e19d86365f14bd3c4c172480c23f918a7a5694aaaef63c995dac7c2 WatchSource:0}: Error finding container d3c7ff156e19d86365f14bd3c4c172480c23f918a7a5694aaaef63c995dac7c2: Status 404 returned error can't find the container with id d3c7ff156e19d86365f14bd3c4c172480c23f918a7a5694aaaef63c995dac7c2
Sep 12 02:49:55.807396 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:55.807360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng" event={"ID":"8c99f42c-207f-4e38-ab4e-448199b5ba9f","Type":"ContainerStarted","Data":"d3c7ff156e19d86365f14bd3c4c172480c23f918a7a5694aaaef63c995dac7c2"}
Sep 12 02:49:56.820644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:56.820607    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng" event={"ID":"8c99f42c-207f-4e38-ab4e-448199b5ba9f","Type":"ContainerStarted","Data":"ca8de51266a0fa5a2130d1631db08e3d0b16dfead5bd05a35344a81f46a90f5a"}
Sep 12 02:49:56.838046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:49:56.838001    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng" podStartSLOduration=1.662813087 podStartE2EDuration="2.837986681s" totalImagesPullingTime="1.175173594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:49:56.83619092 +0000 UTC m=+829.092171931" watchObservedRunningTime="2026-09-12 02:49:56.837986681 +0000 UTC m=+829.093967695"
Sep 12 02:50:05.039642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:05.039608    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:50:05.040018 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:05.039666    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:50:05.052416 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:05.052377    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:50:05.881082 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:05.881052    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng"
Sep 12 02:50:17.408460 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.408426    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"]
Sep 12 02:50:17.413217 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.413195    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.415485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.415460    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 12 02:50:17.419808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.419783    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"]
Sep 12 02:50:17.502310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.502281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.502465 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.502318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.502465 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.502339    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa560f9-6171-4693-a1d4-4f82145c7230-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.502465 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.502387    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.502628 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.502464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.502628 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.502498    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94nz2\" (UniqueName: \"kubernetes.io/projected/1aa560f9-6171-4693-a1d4-4f82145c7230-kube-api-access-94nz2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603509 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603512    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94nz2\" (UniqueName: \"kubernetes.io/projected/1aa560f9-6171-4693-a1d4-4f82145c7230-kube-api-access-94nz2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603566    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa560f9-6171-4693-a1d4-4f82145c7230-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603797 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.603981 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.604043 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.603986    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.604043 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.604011    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.605732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.605710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1aa560f9-6171-4693-a1d4-4f82145c7230-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.605988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.605973    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1aa560f9-6171-4693-a1d4-4f82145c7230-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.611440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.611419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94nz2\" (UniqueName: \"kubernetes.io/projected/1aa560f9-6171-4693-a1d4-4f82145c7230-kube-api-access-94nz2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kxptq\" (UID: \"1aa560f9-6171-4693-a1d4-4f82145c7230\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.725590 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.725520    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:17.996300 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:17.996270    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"]
Sep 12 02:50:17.997632 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:50:17.997609    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa560f9_6171_4693_a1d4_4f82145c7230.slice/crio-0ae074045e9e262e0ef8e455240b6781d164c9af26f70628204c6b899de10570 WatchSource:0}: Error finding container 0ae074045e9e262e0ef8e455240b6781d164c9af26f70628204c6b899de10570: Status 404 returned error can't find the container with id 0ae074045e9e262e0ef8e455240b6781d164c9af26f70628204c6b899de10570
Sep 12 02:50:18.943748 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:18.943706    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq" event={"ID":"1aa560f9-6171-4693-a1d4-4f82145c7230","Type":"ContainerStarted","Data":"0938da444df331dc6dc1e44393b381d021967e4da63ee17a61add298a93b9f6e"}
Sep 12 02:50:18.944096 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:18.943773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq" event={"ID":"1aa560f9-6171-4693-a1d4-4f82145c7230","Type":"ContainerStarted","Data":"0ae074045e9e262e0ef8e455240b6781d164c9af26f70628204c6b899de10570"}
Sep 12 02:50:18.961166 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:18.961119    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq" podStartSLOduration=1.7893099810000002 podStartE2EDuration="1.961099391s" totalImagesPullingTime="171.78941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:50:18.96045941 +0000 UTC m=+851.216440425" watchObservedRunningTime="2026-09-12 02:50:18.961099391 +0000 UTC m=+851.217080407"
Sep 12 02:50:27.726276 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:27.726232    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:27.726742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:27.726305    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:27.738367 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:27.738342    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:28.003216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:28.003144    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kxptq"
Sep 12 02:50:29.121663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.121630    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"]
Sep 12 02:50:29.125475 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.125451    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.127960 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.127936    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 12 02:50:29.134691 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.134668    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"]
Sep 12 02:50:29.209980 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.209948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llw2x\" (UniqueName: \"kubernetes.io/projected/6acac096-9360-425a-aa5d-decdb40e9a20-kube-api-access-llw2x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.210129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.210004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.210129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.210049    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.210129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.210078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6acac096-9360-425a-aa5d-decdb40e9a20-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.210129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.210101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.210129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.210120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.310568 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.310533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llw2x\" (UniqueName: \"kubernetes.io/projected/6acac096-9360-425a-aa5d-decdb40e9a20-kube-api-access-llw2x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.310760 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.310592    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.310760 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.310614    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.310760 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.310645    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6acac096-9360-425a-aa5d-decdb40e9a20-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.310760 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.310678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.310760 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.310700    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.311115 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.311094    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.311179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.311146    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.311179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.311161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.312976 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.312948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6acac096-9360-425a-aa5d-decdb40e9a20-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.313215 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.313199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6acac096-9360-425a-aa5d-decdb40e9a20-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.318173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.318155    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llw2x\" (UniqueName: \"kubernetes.io/projected/6acac096-9360-425a-aa5d-decdb40e9a20-kube-api-access-llw2x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk\" (UID: \"6acac096-9360-425a-aa5d-decdb40e9a20\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.438176 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.438100    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:29.709634 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:29.709606    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"]
Sep 12 02:50:29.711700 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:50:29.711670    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6acac096_9360_425a_aa5d_decdb40e9a20.slice/crio-de14a3b00972cc550541f79fb904d700088f1ac7a0b55c3dc74bb75e52614ed3 WatchSource:0}: Error finding container de14a3b00972cc550541f79fb904d700088f1ac7a0b55c3dc74bb75e52614ed3: Status 404 returned error can't find the container with id de14a3b00972cc550541f79fb904d700088f1ac7a0b55c3dc74bb75e52614ed3
Sep 12 02:50:30.004850 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:30.004767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk" event={"ID":"6acac096-9360-425a-aa5d-decdb40e9a20","Type":"ContainerStarted","Data":"d3e53c335701fc0cb2a0964cca2abb5124962d6555c788cd70e229963641e747"}
Sep 12 02:50:30.004850 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:30.004833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk" event={"ID":"6acac096-9360-425a-aa5d-decdb40e9a20","Type":"ContainerStarted","Data":"de14a3b00972cc550541f79fb904d700088f1ac7a0b55c3dc74bb75e52614ed3"}
Sep 12 02:50:30.021291 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:30.021247    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk" podStartSLOduration=0.857747145 podStartE2EDuration="1.021231768s" totalImagesPullingTime="163.484623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:50:30.019510564 +0000 UTC m=+862.275491580" watchObservedRunningTime="2026-09-12 02:50:30.021231768 +0000 UTC m=+862.277212783"
Sep 12 02:50:39.439187 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:39.439155    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:39.439685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:39.439233    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:39.451376 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:39.451354    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:50:40.070938 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:50:40.070908    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk"
Sep 12 02:51:08.539883 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:51:08.539773    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:51:08.545764 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:51:08.540735    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:51:08.545764 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:51:08.543327    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:51:08.545764 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:51:08.544274    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:52:19.139143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.139103    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"]
Sep 12 02:52:19.149098 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.147811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.150741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.150717    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-c6190b-openshift-default-dockercfg-pd9wc\""
Sep 12 02:52:19.155789 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.155760    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"]
Sep 12 02:52:19.202032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.201990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7060a897-6828-4452-8ada-ae311777df0a-istiod-ca-cert\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kp8f\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-kube-api-access-9kp8f\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-certs\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7060a897-6828-4452-8ada-ae311777df0a-istio-podinfo\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-socket\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-data\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202296    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-credential-socket\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-istio-token\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.202479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.202394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-envoy\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.281837 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.281805    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"]
Sep 12 02:52:19.285483 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.285459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.287777 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.287752    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a07b10-openshift-default-dockercfg-xjr6m\""
Sep 12 02:52:19.299187 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.299162    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"]
Sep 12 02:52:19.303302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-envoy\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303331    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvpf6\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-kube-api-access-pvpf6\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.303486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7060a897-6828-4452-8ada-ae311777df0a-istiod-ca-cert\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kp8f\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-kube-api-access-9kp8f\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303441    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-certs\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-socket\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7060a897-6828-4452-8ada-ae311777df0a-istio-podinfo\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1755ced-7a50-46aa-8c68-a61c96c02a12-istiod-ca-cert\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-socket\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303606    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-envoy\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-certs\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303672    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-credential-socket\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-data\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.303767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-data\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-credential-socket\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-token\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-certs\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-istio-token\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.303936    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-podinfo\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.304027    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-socket\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.304173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.304168    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7060a897-6828-4452-8ada-ae311777df0a-istiod-ca-cert\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.304591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.304247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-data\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.304591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.304343    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-credential-socket\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.306120 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.306090    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-envoy\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.306561 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.306542    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7060a897-6828-4452-8ada-ae311777df0a-istio-podinfo\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.316094 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.316070    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kp8f\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-kube-api-access-9kp8f\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.317720 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.317697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-istio-token\") pod \"e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") " pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.405312 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvpf6\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-kube-api-access-pvpf6\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405312 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-socket\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405312 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1755ced-7a50-46aa-8c68-a61c96c02a12-istiod-ca-cert\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-envoy\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-certs\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-credential-socket\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-data\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-token\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405644 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-podinfo\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-socket\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-certs\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.405935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-credential-socket\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.406032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.405957    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-data\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.406432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.406385    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1755ced-7a50-46aa-8c68-a61c96c02a12-istiod-ca-cert\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.407992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.407972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-envoy\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.408197 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.408176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-podinfo\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.413355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.413328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-token\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.413502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.413401    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvpf6\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-kube-api-access-pvpf6\") pod \"e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") " pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.460928 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.460896    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:19.596211 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.596180    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:19.746266 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.746243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"]
Sep 12 02:52:19.747239 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:19.747215    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7060a897_6828_4452_8ada_ae311777df0a.slice/crio-8cc3044525f3dcd3fd2f2a823ca46199e785fae132abf618d157aaf66bb243a3 WatchSource:0}: Error finding container 8cc3044525f3dcd3fd2f2a823ca46199e785fae132abf618d157aaf66bb243a3: Status 404 returned error can't find the container with id 8cc3044525f3dcd3fd2f2a823ca46199e785fae132abf618d157aaf66bb243a3
Sep 12 02:52:19.749347 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.749316    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:19.749470 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.749392    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:19.749532 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.749472    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:19.868518 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.868495    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"]
Sep 12 02:52:19.870917 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:19.870885    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1755ced_7a50_46aa_8c68_a61c96c02a12.slice/crio-f0f36d590384b898289b7e4e5ca3d3574e2d774b835de30d814f672ba83298ca WatchSource:0}: Error finding container f0f36d590384b898289b7e4e5ca3d3574e2d774b835de30d814f672ba83298ca: Status 404 returned error can't find the container with id f0f36d590384b898289b7e4e5ca3d3574e2d774b835de30d814f672ba83298ca
Sep 12 02:52:19.873578 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.873546    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:19.873669 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.873611    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:19.873669 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:19.873638    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:20.607246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:20.607211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" event={"ID":"a1755ced-7a50-46aa-8c68-a61c96c02a12","Type":"ContainerStarted","Data":"0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"}
Sep 12 02:52:20.607692 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:20.607264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" event={"ID":"a1755ced-7a50-46aa-8c68-a61c96c02a12","Type":"ContainerStarted","Data":"f0f36d590384b898289b7e4e5ca3d3574e2d774b835de30d814f672ba83298ca"}
Sep 12 02:52:20.608871 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:20.608847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" event={"ID":"7060a897-6828-4452-8ada-ae311777df0a","Type":"ContainerStarted","Data":"b79ab846eec749a58f0ed87e0113c37211ff970cd9a7cd69eaffbbcf56edac21"}
Sep 12 02:52:20.608956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:20.608887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" event={"ID":"7060a897-6828-4452-8ada-ae311777df0a","Type":"ContainerStarted","Data":"8cc3044525f3dcd3fd2f2a823ca46199e785fae132abf618d157aaf66bb243a3"}
Sep 12 02:52:20.629711 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:20.629671    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podStartSLOduration=1.629657205 podStartE2EDuration="1.629657205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:20.627932849 +0000 UTC m=+972.883913868" watchObservedRunningTime="2026-09-12 02:52:20.629657205 +0000 UTC m=+972.885638220"
Sep 12 02:52:20.654018 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:20.653978    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podStartSLOduration=1.6539660889999999 podStartE2EDuration="1.653966089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:20.653281427 +0000 UTC m=+972.909262443" watchObservedRunningTime="2026-09-12 02:52:20.653966089 +0000 UTC m=+972.909947103"
Sep 12 02:52:21.461167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.461137    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:21.466228 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.466198    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:21.596627 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.596598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:21.601445 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.601424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:21.614996 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.614970    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:21.615318 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.615023    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:21.615629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.615612    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:21.615751 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:21.615735    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:24.544962 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.544930    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"]
Sep 12 02:52:24.548683 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.548665    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.551349 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.551327    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-b0573c\""
Sep 12 02:52:24.551636 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.551619    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-b0573c-dockercfg-86nrg\""
Sep 12 02:52:24.559629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.559606    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"]
Sep 12 02:52:24.657968 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.657815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcq29\" (UniqueName: \"kubernetes.io/projected/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-kube-api-access-fcq29\") pod \"payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.658152 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.657974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.758919 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.758883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.759080 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.758966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcq29\" (UniqueName: \"kubernetes.io/projected/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-kube-api-access-fcq29\") pod \"payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.759673 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.759650    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.766790 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.766764    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcq29\" (UniqueName: \"kubernetes.io/projected/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-kube-api-access-fcq29\") pod \"payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:24.860871 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:24.860837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:25.136552 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:25.136527    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"]
Sep 12 02:52:25.138399 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:25.138371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9f5210_3d05_4b46_a6fe_ddd7c6b9f3bd.slice/crio-57d51880889e849abdcd9be2bd7b7d1f00e8b6a203c8df4329e26d91fcd5ef03 WatchSource:0}: Error finding container 57d51880889e849abdcd9be2bd7b7d1f00e8b6a203c8df4329e26d91fcd5ef03: Status 404 returned error can't find the container with id 57d51880889e849abdcd9be2bd7b7d1f00e8b6a203c8df4329e26d91fcd5ef03
Sep 12 02:52:25.639978 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:25.639935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b" event={"ID":"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd","Type":"ContainerStarted","Data":"d12f1d41e684358f8f4be204b84adcfc85b07027b2b8d36529a7bf1378124b0f"}
Sep 12 02:52:25.640327 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:25.640001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b" event={"ID":"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd","Type":"ContainerStarted","Data":"57d51880889e849abdcd9be2bd7b7d1f00e8b6a203c8df4329e26d91fcd5ef03"}
Sep 12 02:52:25.640327 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:25.640106    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:25.656657 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:25.656611    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b" podStartSLOduration=1.656597221 podStartE2EDuration="1.656597221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:25.655698296 +0000 UTC m=+977.911679312" watchObservedRunningTime="2026-09-12 02:52:25.656597221 +0000 UTC m=+977.912578236"
Sep 12 02:52:26.321006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.320970    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"]
Sep 12 02:52:26.324622 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.324604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.326962 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.326936    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-c6190b-dockercfg-9mfhd\""
Sep 12 02:52:26.327084 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.326963    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-c6190b\""
Sep 12 02:52:26.337885 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.337866    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"]
Sep 12 02:52:26.375129 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.375101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdjwz\" (UniqueName: \"kubernetes.io/projected/d7c99fe2-68db-4fed-a596-737cc216e16d-kube-api-access-zdjwz\") pod \"payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.375291 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.375199    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7c99fe2-68db-4fed-a596-737cc216e16d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.475972 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.475938    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdjwz\" (UniqueName: \"kubernetes.io/projected/d7c99fe2-68db-4fed-a596-737cc216e16d-kube-api-access-zdjwz\") pod \"payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.476126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.476017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7c99fe2-68db-4fed-a596-737cc216e16d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.476741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.476722    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7c99fe2-68db-4fed-a596-737cc216e16d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.483742 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.483720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdjwz\" (UniqueName: \"kubernetes.io/projected/d7c99fe2-68db-4fed-a596-737cc216e16d-kube-api-access-zdjwz\") pod \"payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.635239 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.635137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:26.910612 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:26.910587    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"]
Sep 12 02:52:26.912099 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:26.912071    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c99fe2_68db_4fed_a596_737cc216e16d.slice/crio-36248c9ee030166e5b1aba08ff3ff0358d4d0426f8d24403f959992303380d6b WatchSource:0}: Error finding container 36248c9ee030166e5b1aba08ff3ff0358d4d0426f8d24403f959992303380d6b: Status 404 returned error can't find the container with id 36248c9ee030166e5b1aba08ff3ff0358d4d0426f8d24403f959992303380d6b
Sep 12 02:52:27.254621 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.254547    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"]
Sep 12 02:52:27.258216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.258199    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.260783 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.260761    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a07b10-dockercfg-sfx85\""
Sep 12 02:52:27.260887 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.260764    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a07b10\""
Sep 12 02:52:27.266399 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.266372    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"]
Sep 12 02:52:27.281324 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.281298    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"]
Sep 12 02:52:27.284838 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.284821    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.296494 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.296470    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"]
Sep 12 02:52:27.383921 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.383888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e3018-45d8-4ae9-8548-ae34260f7541-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.384093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.383961    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjvbk\" (UniqueName: \"kubernetes.io/projected/0c8928f9-1ded-484a-b0e0-135d7eb84de3-kube-api-access-bjvbk\") pod \"payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.384093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.384028    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8928f9-1ded-484a-b0e0-135d7eb84de3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.384169 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.384094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rst\" (UniqueName: \"kubernetes.io/projected/497e3018-45d8-4ae9-8548-ae34260f7541-kube-api-access-58rst\") pod \"payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.485494 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.485459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjvbk\" (UniqueName: \"kubernetes.io/projected/0c8928f9-1ded-484a-b0e0-135d7eb84de3-kube-api-access-bjvbk\") pod \"payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.485686 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.485508    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8928f9-1ded-484a-b0e0-135d7eb84de3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.485686 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.485551    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rst\" (UniqueName: \"kubernetes.io/projected/497e3018-45d8-4ae9-8548-ae34260f7541-kube-api-access-58rst\") pod \"payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.485686 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.485591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e3018-45d8-4ae9-8548-ae34260f7541-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.486261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.486240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e3018-45d8-4ae9-8548-ae34260f7541-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.486311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.486240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8928f9-1ded-484a-b0e0-135d7eb84de3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.495664 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.495635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rst\" (UniqueName: \"kubernetes.io/projected/497e3018-45d8-4ae9-8548-ae34260f7541-kube-api-access-58rst\") pod \"payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.495779 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.495673    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjvbk\" (UniqueName: \"kubernetes.io/projected/0c8928f9-1ded-484a-b0e0-135d7eb84de3-kube-api-access-bjvbk\") pod \"payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.570940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.570916    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:27.597902 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.597879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:27.655451 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.655362    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl" event={"ID":"d7c99fe2-68db-4fed-a596-737cc216e16d","Type":"ContainerStarted","Data":"479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30"}
Sep 12 02:52:27.655613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.655558    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:27.655613 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.655594    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl" event={"ID":"d7c99fe2-68db-4fed-a596-737cc216e16d","Type":"ContainerStarted","Data":"36248c9ee030166e5b1aba08ff3ff0358d4d0426f8d24403f959992303380d6b"}
Sep 12 02:52:27.681088 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.681031    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl" podStartSLOduration=1.681011549 podStartE2EDuration="1.681011549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:27.678955247 +0000 UTC m=+979.934936273" watchObservedRunningTime="2026-09-12 02:52:27.681011549 +0000 UTC m=+979.936992565"
Sep 12 02:52:27.844052 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.844026    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"]
Sep 12 02:52:27.845397 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:27.845363    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8928f9_1ded_484a_b0e0_135d7eb84de3.slice/crio-77f48af46bb4a34faaabaf23fa53a78bd4bf6449107a14c612ff79a1a398c2fe WatchSource:0}: Error finding container 77f48af46bb4a34faaabaf23fa53a78bd4bf6449107a14c612ff79a1a398c2fe: Status 404 returned error can't find the container with id 77f48af46bb4a34faaabaf23fa53a78bd4bf6449107a14c612ff79a1a398c2fe
Sep 12 02:52:27.885509 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:27.885482    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"]
Sep 12 02:52:27.886798 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:27.886773    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497e3018_45d8_4ae9_8548_ae34260f7541.slice/crio-c51fbf8c65b4e4335c69238a0f645cbab33659334fdd756a12381d5f7095dfe0 WatchSource:0}: Error finding container c51fbf8c65b4e4335c69238a0f645cbab33659334fdd756a12381d5f7095dfe0: Status 404 returned error can't find the container with id c51fbf8c65b4e4335c69238a0f645cbab33659334fdd756a12381d5f7095dfe0
Sep 12 02:52:28.663833 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.663793    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k" event={"ID":"497e3018-45d8-4ae9-8548-ae34260f7541","Type":"ContainerStarted","Data":"94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081"}
Sep 12 02:52:28.664311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.663860    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k" event={"ID":"497e3018-45d8-4ae9-8548-ae34260f7541","Type":"ContainerStarted","Data":"c51fbf8c65b4e4335c69238a0f645cbab33659334fdd756a12381d5f7095dfe0"}
Sep 12 02:52:28.664311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.663892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:28.665685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.665647    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn" event={"ID":"0c8928f9-1ded-484a-b0e0-135d7eb84de3","Type":"ContainerStarted","Data":"89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d"}
Sep 12 02:52:28.665809 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.665708    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn" event={"ID":"0c8928f9-1ded-484a-b0e0-135d7eb84de3","Type":"ContainerStarted","Data":"77f48af46bb4a34faaabaf23fa53a78bd4bf6449107a14c612ff79a1a398c2fe"}
Sep 12 02:52:28.665809 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.665801    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:28.682155 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.682104    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k" podStartSLOduration=1.682091066 podStartE2EDuration="1.682091066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:28.679392012 +0000 UTC m=+980.935373028" watchObservedRunningTime="2026-09-12 02:52:28.682091066 +0000 UTC m=+980.938072080"
Sep 12 02:52:28.695929 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.695892    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn" podStartSLOduration=1.695880373 podStartE2EDuration="1.695880373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:28.694289712 +0000 UTC m=+980.950270728" watchObservedRunningTime="2026-09-12 02:52:28.695880373 +0000 UTC m=+980.951861392"
Sep 12 02:52:28.861028 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.860986    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"]
Sep 12 02:52:28.864849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.864824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.866974 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.866953    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-214c0e42-openshift-default-dockercfg-lt5m7\""
Sep 12 02:52:28.876668 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.876643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"]
Sep 12 02:52:28.898761 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-data\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.898872 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-token\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.898872 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-certs\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.898872 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcxr\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-kube-api-access-xzcxr\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.899052 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898877    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-podinfo\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.899052 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-socket\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.899052 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.898990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-credential-socket\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.899052 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.899016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-envoy\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:28.899224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:28.899078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istiod-ca-cert\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000624 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istiod-ca-cert\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000782 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000630    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-data\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000782 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-token\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000782 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000733    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-certs\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000782 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcxr\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-kube-api-access-xzcxr\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000999 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-podinfo\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000999 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-socket\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000999 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-credential-socket\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.000999 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.000911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-envoy\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.001297 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.001270    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-certs\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.001380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.001311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-data\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.001380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.001339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istiod-ca-cert\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.001572 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.001398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-credential-socket\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.001733 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.001710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-socket\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.003354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.003332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-envoy\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.003532 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.003512    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-podinfo\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.018812 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.018790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-token\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.018917 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.018878    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcxr\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-kube-api-access-xzcxr\") pod \"e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") " pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.177984 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.177957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:29.465177 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.465145    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"]
Sep 12 02:52:29.465953 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:29.465929    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddab39e_a2db_4e65_a2ca_c4fb58241cb1.slice/crio-c9fd5d68a247d13db0f1f85c6cc83d94d2cdc0b0ac89f88c0361f552ff56f621 WatchSource:0}: Error finding container c9fd5d68a247d13db0f1f85c6cc83d94d2cdc0b0ac89f88c0361f552ff56f621: Status 404 returned error can't find the container with id c9fd5d68a247d13db0f1f85c6cc83d94d2cdc0b0ac89f88c0361f552ff56f621
Sep 12 02:52:29.468206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.468179    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:29.468277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.468239    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:29.468277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.468268    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:29.674077 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.674037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" event={"ID":"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1","Type":"ContainerStarted","Data":"197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"}
Sep 12 02:52:29.674583 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:29.674102    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" event={"ID":"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1","Type":"ContainerStarted","Data":"c9fd5d68a247d13db0f1f85c6cc83d94d2cdc0b0ac89f88c0361f552ff56f621"}
Sep 12 02:52:30.178205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:30.178173    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:30.179536 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:30.179500    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 12 02:52:30.179647 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:30.179561    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 12 02:52:31.182432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:31.182339    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:31.214332 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:31.214276    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podStartSLOduration=3.2142601490000002 podStartE2EDuration="3.214260149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:29.697074736 +0000 UTC m=+981.953055753" watchObservedRunningTime="2026-09-12 02:52:31.214260149 +0000 UTC m=+983.470241163"
Sep 12 02:52:31.686682 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:31.686645    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:31.687517 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:31.687496    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:34.774835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.774799    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"]
Sep 12 02:52:34.778629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.778609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:34.781102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.781083    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-214c0e42\""
Sep 12 02:52:34.781309 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.781296    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-214c0e42-dockercfg-bwshz\""
Sep 12 02:52:34.787434 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.787377    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"]
Sep 12 02:52:34.871502 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.871458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcj8l\" (UniqueName: \"kubernetes.io/projected/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-kube-api-access-vcj8l\") pod \"payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:34.871663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.871546    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:34.972958 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.972919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:34.973141 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.973017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcj8l\" (UniqueName: \"kubernetes.io/projected/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-kube-api-access-vcj8l\") pod \"payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:34.973946 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.973925    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:34.981852 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:34.981831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcj8l\" (UniqueName: \"kubernetes.io/projected/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-kube-api-access-vcj8l\") pod \"payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:35.089422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.089380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:35.409648 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.408898    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"]
Sep 12 02:52:35.746485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.729139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6" event={"ID":"da2cb4a6-16ba-4283-9610-b6f2a9a2f844","Type":"ContainerStarted","Data":"4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864"}
Sep 12 02:52:35.746485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.729203    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6" event={"ID":"da2cb4a6-16ba-4283-9610-b6f2a9a2f844","Type":"ContainerStarted","Data":"1e74f3552dbbe3216d5d1ad429d11493e03f3cfc0e249ddb4e91fc6544b12a23"}
Sep 12 02:52:35.746485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.729987    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:35.800634 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.800575    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6" podStartSLOduration=1.800555739 podStartE2EDuration="1.800555739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:35.766753795 +0000 UTC m=+988.022734813" watchObservedRunningTime="2026-09-12 02:52:35.800555739 +0000 UTC m=+988.056536753"
Sep 12 02:52:35.813438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.801126    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"]
Sep 12 02:52:35.819615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.819591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:35.825756 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.825726    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-4b3be7-dockercfg-vs7nm\""
Sep 12 02:52:35.826077 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.826055    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-4b3be7\""
Sep 12 02:52:35.856537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.856453    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"]
Sep 12 02:52:35.867444 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.866820    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"]
Sep 12 02:52:35.875615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.875592    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"]
Sep 12 02:52:35.875863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.875847    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:35.882875 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.882850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:35.883027 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.883010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlnrg\" (UniqueName: \"kubernetes.io/projected/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-kube-api-access-dlnrg\") pod \"payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:35.984046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.984007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f621527-a23d-4bd1-abfe-3658115ff2ff-plugins-config-volume\") pod \"payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") " pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:35.984046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.984047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4lnn\" (UniqueName: \"kubernetes.io/projected/5f621527-a23d-4bd1-abfe-3658115ff2ff-kube-api-access-h4lnn\") pod \"payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") " pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:35.984299 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.984158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:35.984299 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.984196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlnrg\" (UniqueName: \"kubernetes.io/projected/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-kube-api-access-dlnrg\") pod \"payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:35.984841 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.984824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:35.991820 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:35.991790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlnrg\" (UniqueName: \"kubernetes.io/projected/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-kube-api-access-dlnrg\") pod \"payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:36.091662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.086035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f621527-a23d-4bd1-abfe-3658115ff2ff-plugins-config-volume\") pod \"payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") " pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:36.091662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.086136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4lnn\" (UniqueName: \"kubernetes.io/projected/5f621527-a23d-4bd1-abfe-3658115ff2ff-kube-api-access-h4lnn\") pod \"payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") " pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:36.091662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.086767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f621527-a23d-4bd1-abfe-3658115ff2ff-plugins-config-volume\") pod \"payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") " pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:36.094974 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.094948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4lnn\" (UniqueName: \"kubernetes.io/projected/5f621527-a23d-4bd1-abfe-3658115ff2ff-kube-api-access-h4lnn\") pod \"payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") " pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:36.159276 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.159237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:36.189427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.189372    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:36.522516 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.522430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"]
Sep 12 02:52:36.557438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.556209    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"]
Sep 12 02:52:36.569314 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:36.569289    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f621527_a23d_4bd1_abfe_3658115ff2ff.slice/crio-2f98aed95c9654eb679fe5b1623611a6fdd9da2a6ee234b45b5d7335085f368e WatchSource:0}: Error finding container 2f98aed95c9654eb679fe5b1623611a6fdd9da2a6ee234b45b5d7335085f368e: Status 404 returned error can't find the container with id 2f98aed95c9654eb679fe5b1623611a6fdd9da2a6ee234b45b5d7335085f368e
Sep 12 02:52:36.652425 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.650587    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 02:52:36.753482 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.749880    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9" event={"ID":"5f621527-a23d-4bd1-abfe-3658115ff2ff","Type":"ContainerStarted","Data":"ff0aeb55afb0c75fb676de91f3abbc015568746ae3bef30b1951f7169074f0e8"}
Sep 12 02:52:36.753482 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.749948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9" event={"ID":"5f621527-a23d-4bd1-abfe-3658115ff2ff","Type":"ContainerStarted","Data":"2f98aed95c9654eb679fe5b1623611a6fdd9da2a6ee234b45b5d7335085f368e"}
Sep 12 02:52:36.753482 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.750748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:36.753750 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.753728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk" event={"ID":"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16","Type":"ContainerStarted","Data":"097d91355445a6b61647a5e834a13ba0f66de5efca6573c3cd906a54402e4487"}
Sep 12 02:52:36.753818 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.753773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk" event={"ID":"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16","Type":"ContainerStarted","Data":"e580d8a4c055e9eb5af2f9ee60147b4c7c53ea17cbf38c96f6e1a01ad90c1494"}
Sep 12 02:52:36.753818 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.753802    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:36.788697 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.788416    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9" podStartSLOduration=1.7883806340000001 podStartE2EDuration="1.788380634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:36.782752653 +0000 UTC m=+989.038733670" watchObservedRunningTime="2026-09-12 02:52:36.788380634 +0000 UTC m=+989.044361651"
Sep 12 02:52:36.813559 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:36.813499    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk" podStartSLOduration=1.813468629 podStartE2EDuration="1.813468629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:52:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:52:36.809851039 +0000 UTC m=+989.065832058" watchObservedRunningTime="2026-09-12 02:52:36.813468629 +0000 UTC m=+989.069449647"
Sep 12 02:52:38.668641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:38.668604    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 02:52:39.676107 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:39.676076    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:52:39.676526 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:39.676148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:52:41.802774 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.802734    2583 generic.go:356] "Generic (PLEG): container finished" podID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerID="0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf" exitCode=0
Sep 12 02:52:41.804400 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.803358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" event={"ID":"a1755ced-7a50-46aa-8c68-a61c96c02a12","Type":"ContainerDied","Data":"0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"}
Sep 12 02:52:41.804400 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.803989    2583 scope.go:117] "RemoveContainer" containerID="0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"
Sep 12 02:52:41.805670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.805630    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:41.805770 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.805728    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:41.805834 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.805773    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:41.833082 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.833040    2583 generic.go:356] "Generic (PLEG): container finished" podID="7060a897-6828-4452-8ada-ae311777df0a" containerID="b79ab846eec749a58f0ed87e0113c37211ff970cd9a7cd69eaffbbcf56edac21" exitCode=0
Sep 12 02:52:41.833281 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.833258    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" event={"ID":"7060a897-6828-4452-8ada-ae311777df0a","Type":"ContainerDied","Data":"b79ab846eec749a58f0ed87e0113c37211ff970cd9a7cd69eaffbbcf56edac21"}
Sep 12 02:52:41.833864 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.833823    2583 scope.go:117] "RemoveContainer" containerID="b79ab846eec749a58f0ed87e0113c37211ff970cd9a7cd69eaffbbcf56edac21"
Sep 12 02:52:41.836022 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.835991    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:41.836260 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.836238    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:41.836424 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:41.836388    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:42.845480 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:42.845440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" event={"ID":"a1755ced-7a50-46aa-8c68-a61c96c02a12","Type":"ContainerStarted","Data":"22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533"}
Sep 12 02:52:42.848954 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:42.848917    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" event={"ID":"7060a897-6828-4452-8ada-ae311777df0a","Type":"ContainerStarted","Data":"8de511a151daf351ee55146d1b96b713431d41c82d156af409d0617eaf130bcf"}
Sep 12 02:52:43.471432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:43.470872    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:43.471432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:43.471001    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 12 02:52:43.471432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:43.471046    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 12 02:52:43.596352 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:43.596311    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:43.596639 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:43.596613    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 12 02:52:43.596720 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:43.596660    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 12 02:52:44.461929 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:44.461880    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 12 02:52:44.462545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:44.461964    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 12 02:52:44.597178 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:44.597138    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 12 02:52:44.597341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:44.597209    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 12 02:52:45.461825 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:45.461772    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 12 02:52:45.462049 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:45.461850    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 12 02:52:45.597032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:45.596995    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 12 02:52:45.597205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:45.597060    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 12 02:52:46.462148 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:46.462101    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 12 02:52:46.462642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:46.462172    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 12 02:52:46.596930 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:46.596890    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 12 02:52:46.597104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:46.596946    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 12 02:52:47.462047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.462007    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 12 02:52:47.462216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.462063    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 12 02:52:47.597347 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.597017    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 12 02:52:47.597347 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.597069    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 12 02:52:47.687422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.687375    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 02:52:47.687643 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.687622    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 02:52:47.760985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.760898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:52:47.761545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:47.761525    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:52:48.523629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:48.521962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:48.523629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:48.523464    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:48.529094 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:48.529040    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 02:52:48.597007 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:48.596972    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 12 02:52:48.597173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:48.597035    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 12 02:52:48.783357 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:48.783265    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:52:49.600959 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:49.600929    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:49.601438 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:49.601359    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:49.602006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:49.601983    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 02:52:50.920161 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:50.920088    2583 generic.go:356] "Generic (PLEG): container finished" podID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerID="197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626" exitCode=0
Sep 12 02:52:50.920564 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:50.920165    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" event={"ID":"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1","Type":"ContainerDied","Data":"197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"}
Sep 12 02:52:50.920698 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:50.920682    2583 scope.go:117] "RemoveContainer" containerID="197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"
Sep 12 02:52:50.921882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:50.921852    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:50.922008 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:50.921923    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:50.922008 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:50.921956    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:52:51.518095 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.518053    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"]
Sep 12 02:52:51.526238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.526205    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:51.529113 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.529086    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"]
Sep 12 02:52:51.529844 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.529819    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:52:51.530071 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.530051    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:52:51.615427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.612002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1466379d-eae9-49e0-98db-81f088bf1509-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7\" (UID: \"1466379d-eae9-49e0-98db-81f088bf1509\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:51.713693 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.713641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1466379d-eae9-49e0-98db-81f088bf1509-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7\" (UID: \"1466379d-eae9-49e0-98db-81f088bf1509\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:51.714575 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.714544    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1466379d-eae9-49e0-98db-81f088bf1509-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7\" (UID: \"1466379d-eae9-49e0-98db-81f088bf1509\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:51.839807 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.839779    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:51.953674 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:51.953644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" event={"ID":"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1","Type":"ContainerStarted","Data":"71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6"}
Sep 12 02:52:52.145905 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:52.145877    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"]
Sep 12 02:52:52.146172 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:52:52.146151    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1466379d_eae9_49e0_98db_81f088bf1509.slice/crio-acdac465a62cbcf1de3b720b5bafd32f7b2d41d37be2fb52fe7493d842ba93c6 WatchSource:0}: Error finding container acdac465a62cbcf1de3b720b5bafd32f7b2d41d37be2fb52fe7493d842ba93c6: Status 404 returned error can't find the container with id acdac465a62cbcf1de3b720b5bafd32f7b2d41d37be2fb52fe7493d842ba93c6
Sep 12 02:52:52.148198 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:52.148182    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 12 02:52:52.178847 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:52.178822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:52.178983 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:52.178964    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 12 02:52:52.179027 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:52.179004    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 12 02:52:52.964127 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:52.964088    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7" event={"ID":"1466379d-eae9-49e0-98db-81f088bf1509","Type":"ContainerStarted","Data":"acdac465a62cbcf1de3b720b5bafd32f7b2d41d37be2fb52fe7493d842ba93c6"}
Sep 12 02:52:53.178817 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:53.178773    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 12 02:52:53.179006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:53.178847    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 12 02:52:54.178773 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:54.178740    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 12 02:52:54.179237 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:54.178790    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 12 02:52:55.179055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:55.179019    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 12 02:52:55.179446 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:55.179070    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 12 02:52:55.985772 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:55.985685    2583 generic.go:356] "Generic (PLEG): container finished" podID="1466379d-eae9-49e0-98db-81f088bf1509" containerID="67127b46366cae5f07c232e65420da6d68a86a1236b9a68b74878e26099671b3" exitCode=0
Sep 12 02:52:55.985935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:55.985773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7" event={"ID":"1466379d-eae9-49e0-98db-81f088bf1509","Type":"ContainerDied","Data":"67127b46366cae5f07c232e65420da6d68a86a1236b9a68b74878e26099671b3"}
Sep 12 02:52:56.178702 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:56.178656    2583 patch_prober.go:28] interesting pod/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 12 02:52:56.178986 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:56.178950    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 12 02:52:57.133542 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.133518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:57.179032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.179003    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1466379d-eae9-49e0-98db-81f088bf1509-maas-api-service-ca\") pod \"1466379d-eae9-49e0-98db-81f088bf1509\" (UID: \"1466379d-eae9-49e0-98db-81f088bf1509\") "
Sep 12 02:52:57.179345 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.179322    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1466379d-eae9-49e0-98db-81f088bf1509-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1466379d-eae9-49e0-98db-81f088bf1509" (UID: "1466379d-eae9-49e0-98db-81f088bf1509"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:52:57.179433 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.179400    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1466379d-eae9-49e0-98db-81f088bf1509-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:52:57.182571 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.182552    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:57.182980 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.182963    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:57.183531 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.183514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:52:57.999565 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.999537    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"
Sep 12 02:52:57.999724 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.999577    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7" event={"ID":"1466379d-eae9-49e0-98db-81f088bf1509","Type":"ContainerDied","Data":"acdac465a62cbcf1de3b720b5bafd32f7b2d41d37be2fb52fe7493d842ba93c6"}
Sep 12 02:52:57.999724 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:52:57.999632    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acdac465a62cbcf1de3b720b5bafd32f7b2d41d37be2fb52fe7493d842ba93c6"
Sep 12 02:53:02.240741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.240711    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"]
Sep 12 02:53:02.241206 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.240922    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6" podUID="da2cb4a6-16ba-4283-9610-b6f2a9a2f844" containerName="payload-pre-processing" containerID="cri-o://4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864" gracePeriod=30
Sep 12 02:53:02.395454 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.395391    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"]
Sep 12 02:53:02.398090 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.398066    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-214c0e42-2tnz7"]
Sep 12 02:53:02.503681 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.503631    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:53:02.548287 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.548251    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"]
Sep 12 02:53:02.548534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.548506    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy" containerID="cri-o://71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6" gracePeriod=30
Sep 12 02:53:02.635236 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.635213    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-plugins-config-volume\") pod \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") "
Sep 12 02:53:02.635401 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.635279    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcj8l\" (UniqueName: \"kubernetes.io/projected/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-kube-api-access-vcj8l\") pod \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\" (UID: \"da2cb4a6-16ba-4283-9610-b6f2a9a2f844\") "
Sep 12 02:53:02.635676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.635652    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da2cb4a6-16ba-4283-9610-b6f2a9a2f844" (UID: "da2cb4a6-16ba-4283-9610-b6f2a9a2f844"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:53:02.637377 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.637356    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-kube-api-access-vcj8l" (OuterVolumeSpecName: "kube-api-access-vcj8l") pod "da2cb4a6-16ba-4283-9610-b6f2a9a2f844" (UID: "da2cb4a6-16ba-4283-9610-b6f2a9a2f844"). InnerVolumeSpecName "kube-api-access-vcj8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:53:02.736267 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.736222    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcj8l\" (UniqueName: \"kubernetes.io/projected/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-kube-api-access-vcj8l\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:02.736267 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:02.736259    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da2cb4a6-16ba-4283-9610-b6f2a9a2f844-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:03.039113 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.039078    2583 generic.go:356] "Generic (PLEG): container finished" podID="da2cb4a6-16ba-4283-9610-b6f2a9a2f844" containerID="4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864" exitCode=0
Sep 12 02:53:03.039259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.039121    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"
Sep 12 02:53:03.039259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.039155    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6" event={"ID":"da2cb4a6-16ba-4283-9610-b6f2a9a2f844","Type":"ContainerDied","Data":"4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864"}
Sep 12 02:53:03.039259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.039211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6" event={"ID":"da2cb4a6-16ba-4283-9610-b6f2a9a2f844","Type":"ContainerDied","Data":"1e74f3552dbbe3216d5d1ad429d11493e03f3cfc0e249ddb4e91fc6544b12a23"}
Sep 12 02:53:03.039259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.039236    2583 scope.go:117] "RemoveContainer" containerID="4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864"
Sep 12 02:53:03.049092 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.049072    2583 scope.go:117] "RemoveContainer" containerID="4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864"
Sep 12 02:53:03.049532 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:53:03.049424    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864\": container with ID starting with 4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864 not found: ID does not exist" containerID="4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864"
Sep 12 02:53:03.049532 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.049464    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864"} err="failed to get container status \"4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864\": rpc error: code = NotFound desc = could not find container \"4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864\": container with ID starting with 4f0b02162a85dc41baac3c58b280c2e5f7554eba04bd9f89e91d18ec149f8864 not found: ID does not exist"
Sep 12 02:53:03.066039 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.066016    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"]
Sep 12 02:53:03.068625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.068606    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-214c0e42-5cdb79c6b-gx9b6"]
Sep 12 02:53:03.611107 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611078    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"]
Sep 12 02:53:03.611548 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611534    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2cb4a6-16ba-4283-9610-b6f2a9a2f844" containerName="payload-pre-processing"
Sep 12 02:53:03.611601 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611550    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2cb4a6-16ba-4283-9610-b6f2a9a2f844" containerName="payload-pre-processing"
Sep 12 02:53:03.611601 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611581    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1466379d-eae9-49e0-98db-81f088bf1509" containerName="revoke-keys"
Sep 12 02:53:03.611601 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611586    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1466379d-eae9-49e0-98db-81f088bf1509" containerName="revoke-keys"
Sep 12 02:53:03.611710 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611656    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2cb4a6-16ba-4283-9610-b6f2a9a2f844" containerName="payload-pre-processing"
Sep 12 02:53:03.611710 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.611663    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1466379d-eae9-49e0-98db-81f088bf1509" containerName="revoke-keys"
Sep 12 02:53:03.616083 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.616061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.618346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.618330    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-03cd9838-gw-openshift-default-dockercfg-ggq8j\""
Sep 12 02:53:03.636091 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.636067    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"]
Sep 12 02:53:03.745829 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.745796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b685g\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-kube-api-access-b685g\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.745964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.745837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-podinfo\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.745964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.745943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istiod-ca-cert\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.746060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.745979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-token\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.746060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.746002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-socket\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.746167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.746076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-certs\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.746167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.746114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-credential-socket\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.746167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.746151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-data\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.746290 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.746194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-envoy\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istiod-ca-cert\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847235    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-token\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-socket\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-certs\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-credential-socket\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-data\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-envoy\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847497    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b685g\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-kube-api-access-b685g\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.847663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.847542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-podinfo\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.848149 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.848120    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istiod-ca-cert\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.848796 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.848769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-credential-socket\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.849224 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.849202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-certs\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.849514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.849488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-socket\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.850859 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.850837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-podinfo\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.851008 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.850954    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-data\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.851829 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.851794    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-envoy\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.856354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.856331    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-token\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.857223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.857190    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b685g\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-kube-api-access-b685g\") pod \"e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") " pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:03.927496 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:03.927388    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:04.161384 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:04.161353    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1466379d-eae9-49e0-98db-81f088bf1509" path="/var/lib/kubelet/pods/1466379d-eae9-49e0-98db-81f088bf1509/volumes"
Sep 12 02:53:04.161825 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:04.161809    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2cb4a6-16ba-4283-9610-b6f2a9a2f844" path="/var/lib/kubelet/pods/da2cb4a6-16ba-4283-9610-b6f2a9a2f844/volumes"
Sep 12 02:53:04.204901 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:04.204875    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"]
Sep 12 02:53:04.205801 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:53:04.205781    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9dd04e3_bebe_41d1_acf0_34e46b5d422b.slice/crio-faa32c94f4ebb8171b3f4bb1359a2cbf8f138cff093c58d7d1a94f191e272626 WatchSource:0}: Error finding container faa32c94f4ebb8171b3f4bb1359a2cbf8f138cff093c58d7d1a94f191e272626: Status 404 returned error can't find the container with id faa32c94f4ebb8171b3f4bb1359a2cbf8f138cff093c58d7d1a94f191e272626
Sep 12 02:53:04.208214 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:04.208183    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:04.208310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:04.208256    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:04.208310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:04.208293    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:05.056204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:05.056170    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" event={"ID":"f9dd04e3-bebe-41d1-acf0-34e46b5d422b","Type":"ContainerStarted","Data":"47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"}
Sep 12 02:53:05.056596 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:05.056225    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" event={"ID":"f9dd04e3-bebe-41d1-acf0-34e46b5d422b","Type":"ContainerStarted","Data":"faa32c94f4ebb8171b3f4bb1359a2cbf8f138cff093c58d7d1a94f191e272626"}
Sep 12 02:53:05.076199 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:05.076157    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podStartSLOduration=2.076139551 podStartE2EDuration="2.076139551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:53:05.075245184 +0000 UTC m=+1017.331226199" watchObservedRunningTime="2026-09-12 02:53:05.076139551 +0000 UTC m=+1017.332120567"
Sep 12 02:53:05.928152 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:05.928120    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:05.933430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:05.933380    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:06.062980 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:06.062953    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:06.063784 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:06.063768    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:07.797210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.797185    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:53:07.888755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888721    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-certs\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.888932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888766    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-token\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.888932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888786    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzcxr\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-kube-api-access-xzcxr\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.888932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888823    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-socket\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.888932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888847    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-data\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.888932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888869    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-podinfo\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.888932 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888897    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istiod-ca-cert\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.889231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.888996    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-envoy\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.889231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889025    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-credential-socket\") pod \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\" (UID: \"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1\") "
Sep 12 02:53:07.889231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889019    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:07.889231 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:07.889366 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889232    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:07.889471 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889442    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:53:07.889582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889553    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:07.889735 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889719    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.889803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889738    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.889803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889751    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.889803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889763    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.889803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.889771    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.891189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.891161    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-kube-api-access-xzcxr" (OuterVolumeSpecName: "kube-api-access-xzcxr") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "kube-api-access-xzcxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:53:07.891307 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.891223    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:53:07.891365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.891342    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:53:07.891534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.891513    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" (UID: "3ddab39e-a2db-4e65-a2ca-c4fb58241cb1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:07.990922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.990889    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.990922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.990919    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzcxr\" (UniqueName: \"kubernetes.io/projected/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-kube-api-access-xzcxr\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.991115 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.990930    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:07.991115 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:07.990939    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:08.077097 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.077067    2583 generic.go:356] "Generic (PLEG): container finished" podID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerID="71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6" exitCode=0
Sep 12 02:53:08.077254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.077112    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"
Sep 12 02:53:08.077254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.077143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" event={"ID":"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1","Type":"ContainerDied","Data":"71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6"}
Sep 12 02:53:08.077254 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.077235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw" event={"ID":"3ddab39e-a2db-4e65-a2ca-c4fb58241cb1","Type":"ContainerDied","Data":"c9fd5d68a247d13db0f1f85c6cc83d94d2cdc0b0ac89f88c0361f552ff56f621"}
Sep 12 02:53:08.077382 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.077268    2583 scope.go:117] "RemoveContainer" containerID="71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6"
Sep 12 02:53:08.088028 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.088013    2583 scope.go:117] "RemoveContainer" containerID="197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"
Sep 12 02:53:08.099493 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.099472    2583 scope.go:117] "RemoveContainer" containerID="71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6"
Sep 12 02:53:08.099800 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:53:08.099778    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6\": container with ID starting with 71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6 not found: ID does not exist" containerID="71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6"
Sep 12 02:53:08.099903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.099806    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6"} err="failed to get container status \"71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6\": rpc error: code = NotFound desc = could not find container \"71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6\": container with ID starting with 71db2df66738db1ee2f11af5d0dbefedc3d18130c967e2e8d4a1fbc421120da6 not found: ID does not exist"
Sep 12 02:53:08.099903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.099822    2583 scope.go:117] "RemoveContainer" containerID="197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"
Sep 12 02:53:08.100116 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:53:08.100095    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626\": container with ID starting with 197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626 not found: ID does not exist" containerID="197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"
Sep 12 02:53:08.100165 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.100121    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626"} err="failed to get container status \"197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626\": rpc error: code = NotFound desc = could not find container \"197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626\": container with ID starting with 197beb7d14c81181257b12785f7a32b7ce53dade39bda1e9d58ff9a3a9b33626 not found: ID does not exist"
Sep 12 02:53:08.103142 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.103106    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"]
Sep 12 02:53:08.107694 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.107674    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-214c0e42-openshift-default-84c88cbc8b-djfxw"]
Sep 12 02:53:08.161756 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.161686    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" path="/var/lib/kubelet/pods/3ddab39e-a2db-4e65-a2ca-c4fb58241cb1/volumes"
Sep 12 02:53:08.761873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.761842    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"]
Sep 12 02:53:08.762319 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.762306    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy"
Sep 12 02:53:08.762371 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.762321    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy"
Sep 12 02:53:08.762371 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.762331    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy"
Sep 12 02:53:08.762371 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.762336    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy"
Sep 12 02:53:08.762489 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.762427    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy"
Sep 12 02:53:08.762489 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.762435    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ddab39e-a2db-4e65-a2ca-c4fb58241cb1" containerName="istio-proxy"
Sep 12 02:53:08.767047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.767030    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:08.769543 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.769522    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-03cd9838\""
Sep 12 02:53:08.769656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.769559    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-03cd9838-dockercfg-fgpgr\""
Sep 12 02:53:08.774662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.774639    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"]
Sep 12 02:53:08.900323 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.900289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hz4p\" (UniqueName: \"kubernetes.io/projected/60304b43-f8a4-441c-8f82-d30de695006d-kube-api-access-7hz4p\") pod \"payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") " pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:08.900720 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:08.900391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60304b43-f8a4-441c-8f82-d30de695006d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") " pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:09.001641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:09.001604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hz4p\" (UniqueName: \"kubernetes.io/projected/60304b43-f8a4-441c-8f82-d30de695006d-kube-api-access-7hz4p\") pod \"payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") " pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:09.001818 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:09.001672    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60304b43-f8a4-441c-8f82-d30de695006d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") " pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:09.002447 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:09.002399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60304b43-f8a4-441c-8f82-d30de695006d-plugins-config-volume\") pod \"payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") " pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:09.010242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:09.010212    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hz4p\" (UniqueName: \"kubernetes.io/projected/60304b43-f8a4-441c-8f82-d30de695006d-kube-api-access-7hz4p\") pod \"payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") " pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:09.078066 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:09.078043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:09.352589 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:09.352562    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"]
Sep 12 02:53:09.353799 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:53:09.353776    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60304b43_f8a4_441c_8f82_d30de695006d.slice/crio-f07f374a6850b83eb42d104f3d9d3281197eb46d8b640f32471e4ca2a24b4c17 WatchSource:0}: Error finding container f07f374a6850b83eb42d104f3d9d3281197eb46d8b640f32471e4ca2a24b4c17: Status 404 returned error can't find the container with id f07f374a6850b83eb42d104f3d9d3281197eb46d8b640f32471e4ca2a24b4c17
Sep 12 02:53:10.090714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:10.090670    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg" event={"ID":"60304b43-f8a4-441c-8f82-d30de695006d","Type":"ContainerStarted","Data":"7fbccb4e7f3a261dcee125fd20cbbd7613f4bd9c2d92007f8fae25da9a742d89"}
Sep 12 02:53:10.091152 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:10.090728    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg" event={"ID":"60304b43-f8a4-441c-8f82-d30de695006d","Type":"ContainerStarted","Data":"f07f374a6850b83eb42d104f3d9d3281197eb46d8b640f32471e4ca2a24b4c17"}
Sep 12 02:53:10.091152 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:10.090857    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:10.106344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:10.106301    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg" podStartSLOduration=2.106287407 podStartE2EDuration="2.106287407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:53:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:53:10.10545369 +0000 UTC m=+1022.361434705" watchObservedRunningTime="2026-09-12 02:53:10.106287407 +0000 UTC m=+1022.362268421"
Sep 12 02:53:21.099156 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:21.099126    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:26.197938 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:26.197870    2583 generic.go:356] "Generic (PLEG): container finished" podID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerID="47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c" exitCode=0
Sep 12 02:53:26.198306 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:26.197937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" event={"ID":"f9dd04e3-bebe-41d1-acf0-34e46b5d422b","Type":"ContainerDied","Data":"47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"}
Sep 12 02:53:26.198376 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:26.198360    2583 scope.go:117] "RemoveContainer" containerID="47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"
Sep 12 02:53:26.199703 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:26.199674    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:26.199790 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:26.199744    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:26.199790 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:26.199779    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:27.210491 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:27.210454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" event={"ID":"f9dd04e3-bebe-41d1-acf0-34e46b5d422b","Type":"ContainerStarted","Data":"0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201"}
Sep 12 02:53:27.927812 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:27.927777    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:27.928160 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:27.928125    2583 patch_prober.go:28] interesting pod/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 12 02:53:27.928222 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:27.928190    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 12 02:53:28.928662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:28.928623    2583 patch_prober.go:28] interesting pod/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 12 02:53:28.929067 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:28.928695    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 12 02:53:29.928634 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:29.928597    2583 patch_prober.go:28] interesting pod/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 12 02:53:29.928809 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:29.928657    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 12 02:53:30.928236 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:30.928199    2583 patch_prober.go:28] interesting pod/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 12 02:53:30.928485 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:30.928259    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 12 02:53:31.659506 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.659471    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"]
Sep 12 02:53:31.666659 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.666632    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:31.668379 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.668352    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"]
Sep 12 02:53:31.669093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.669069    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:53:31.669093 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.669082    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:53:31.733137 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.733097    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t\" (UID: \"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:31.833674 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.833639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t\" (UID: \"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:31.834307 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.834288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t\" (UID: \"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:31.928261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.928165    2583 patch_prober.go:28] interesting pod/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 12 02:53:31.928436 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.928252    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 12 02:53:31.978814 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:31.978788    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:32.281139 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:32.281048    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"]
Sep 12 02:53:32.286510 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:53:32.286471    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d1a075f_9bc1_4e4f_a6e9_00d7299a8b1b.slice/crio-52c0fa9fe35a8cbd80c04b96d582b38f8876be2d25fff2433390a505131fb393 WatchSource:0}: Error finding container 52c0fa9fe35a8cbd80c04b96d582b38f8876be2d25fff2433390a505131fb393: Status 404 returned error can't find the container with id 52c0fa9fe35a8cbd80c04b96d582b38f8876be2d25fff2433390a505131fb393
Sep 12 02:53:32.932595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:32.932513    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:32.933031 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:32.932923    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:32.933499 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:32.933479    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:33.254460 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:33.254365    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b" containerID="1ed8cd5c77ad8a7be2cfe19b96a269693917c1ca89503f132e1f7d49a415e0fd" exitCode=0
Sep 12 02:53:33.254460 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:33.254432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t" event={"ID":"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b","Type":"ContainerDied","Data":"1ed8cd5c77ad8a7be2cfe19b96a269693917c1ca89503f132e1f7d49a415e0fd"}
Sep 12 02:53:33.254626 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:33.254479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t" event={"ID":"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b","Type":"ContainerStarted","Data":"52c0fa9fe35a8cbd80c04b96d582b38f8876be2d25fff2433390a505131fb393"}
Sep 12 02:53:34.399781 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:34.399380    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:34.458812 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:34.458783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b-maas-api-service-ca\") pod \"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b\" (UID: \"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b\") "
Sep 12 02:53:34.459111 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:34.459088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b" (UID: "5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:53:34.559719 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:34.559640    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:35.267192 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:35.267159    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t" event={"ID":"5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b","Type":"ContainerDied","Data":"52c0fa9fe35a8cbd80c04b96d582b38f8876be2d25fff2433390a505131fb393"}
Sep 12 02:53:35.267358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:35.267196    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"
Sep 12 02:53:35.267358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:35.267205    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52c0fa9fe35a8cbd80c04b96d582b38f8876be2d25fff2433390a505131fb393"
Sep 12 02:53:38.056520 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.056484    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"]
Sep 12 02:53:38.056899 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.056730    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg" podUID="60304b43-f8a4-441c-8f82-d30de695006d" containerName="payload-processing" containerID="cri-o://7fbccb4e7f3a261dcee125fd20cbbd7613f4bd9c2d92007f8fae25da9a742d89" gracePeriod=30
Sep 12 02:53:38.212870 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.212836    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"]
Sep 12 02:53:38.215602 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.215579    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-03cd9838-gb26t"]
Sep 12 02:53:38.292564 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.292527    2583 generic.go:356] "Generic (PLEG): container finished" podID="60304b43-f8a4-441c-8f82-d30de695006d" containerID="7fbccb4e7f3a261dcee125fd20cbbd7613f4bd9c2d92007f8fae25da9a742d89" exitCode=0
Sep 12 02:53:38.292894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.292869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg" event={"ID":"60304b43-f8a4-441c-8f82-d30de695006d","Type":"ContainerDied","Data":"7fbccb4e7f3a261dcee125fd20cbbd7613f4bd9c2d92007f8fae25da9a742d89"}
Sep 12 02:53:38.345004 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.344978    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:38.347364 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.347341    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"]
Sep 12 02:53:38.347633 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.347585    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy" containerID="cri-o://0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201" gracePeriod=30
Sep 12 02:53:38.394471 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.394442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hz4p\" (UniqueName: \"kubernetes.io/projected/60304b43-f8a4-441c-8f82-d30de695006d-kube-api-access-7hz4p\") pod \"60304b43-f8a4-441c-8f82-d30de695006d\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") "
Sep 12 02:53:38.394609 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.394512    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60304b43-f8a4-441c-8f82-d30de695006d-plugins-config-volume\") pod \"60304b43-f8a4-441c-8f82-d30de695006d\" (UID: \"60304b43-f8a4-441c-8f82-d30de695006d\") "
Sep 12 02:53:38.394877 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.394851    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60304b43-f8a4-441c-8f82-d30de695006d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "60304b43-f8a4-441c-8f82-d30de695006d" (UID: "60304b43-f8a4-441c-8f82-d30de695006d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:53:38.396588 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.396561    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60304b43-f8a4-441c-8f82-d30de695006d-kube-api-access-7hz4p" (OuterVolumeSpecName: "kube-api-access-7hz4p") pod "60304b43-f8a4-441c-8f82-d30de695006d" (UID: "60304b43-f8a4-441c-8f82-d30de695006d"). InnerVolumeSpecName "kube-api-access-7hz4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:53:38.495745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.495706    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hz4p\" (UniqueName: \"kubernetes.io/projected/60304b43-f8a4-441c-8f82-d30de695006d-kube-api-access-7hz4p\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:38.495745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:38.495736    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60304b43-f8a4-441c-8f82-d30de695006d-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:39.118174 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118138    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"]
Sep 12 02:53:39.118670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118643    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60304b43-f8a4-441c-8f82-d30de695006d" containerName="payload-processing"
Sep 12 02:53:39.118670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118657    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60304b43-f8a4-441c-8f82-d30de695006d" containerName="payload-processing"
Sep 12 02:53:39.118670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118666    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b" containerName="revoke-keys"
Sep 12 02:53:39.118670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118672    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b" containerName="revoke-keys"
Sep 12 02:53:39.118901 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118760    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b" containerName="revoke-keys"
Sep 12 02:53:39.118901 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.118780    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60304b43-f8a4-441c-8f82-d30de695006d" containerName="payload-processing"
Sep 12 02:53:39.122051 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.122031    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.124320 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.124304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1ac5b7fd-openshift-default-dockercfg-vh9fd\""
Sep 12 02:53:39.132783 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.132759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"]
Sep 12 02:53:39.202586 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-credential-socket\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202586 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202560    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxrx\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-kube-api-access-wtxrx\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-envoy\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-podinfo\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-socket\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-certs\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202754    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-data\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.202849 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-token\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.203098 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.202870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istiod-ca-cert\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.300023 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.299989    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"
Sep 12 02:53:39.300210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.300018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg" event={"ID":"60304b43-f8a4-441c-8f82-d30de695006d","Type":"ContainerDied","Data":"f07f374a6850b83eb42d104f3d9d3281197eb46d8b640f32471e4ca2a24b4c17"}
Sep 12 02:53:39.300210 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.300089    2583 scope.go:117] "RemoveContainer" containerID="7fbccb4e7f3a261dcee125fd20cbbd7613f4bd9c2d92007f8fae25da9a742d89"
Sep 12 02:53:39.303701 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.303673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-token\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.303816 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.303761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istiod-ca-cert\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.303816 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.303803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-credential-socket\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.303943 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.303853    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxrx\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-kube-api-access-wtxrx\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304012 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.303963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-envoy\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304012 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.303998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-podinfo\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304125 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-socket\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304125 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304094    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-certs\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-data\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304289 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304271    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-credential-socket\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304509 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-data\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304607 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-socket\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304719 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304597    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istiod-ca-cert\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.304775 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.304723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-certs\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.306373 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.306353    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-envoy\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.307060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.307038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-podinfo\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.310906 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.310881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-token\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.311000 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.310940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxrx\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-kube-api-access-wtxrx\") pod \"e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") " pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.340662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.340628    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"]
Sep 12 02:53:39.343350 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.343326    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-03cd9838-58c8948d4b-7k5mg"]
Sep 12 02:53:39.433680 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.433604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:39.737185 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.737156    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"]
Sep 12 02:53:39.737731 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:53:39.737706    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4194b08f_c2b7_4f62_a464_13bf0f6ddf19.slice/crio-dbe88088222a4c134c97c851e918c3a5fae45bb7ee409babc0887b88685d97bf WatchSource:0}: Error finding container dbe88088222a4c134c97c851e918c3a5fae45bb7ee409babc0887b88685d97bf: Status 404 returned error can't find the container with id dbe88088222a4c134c97c851e918c3a5fae45bb7ee409babc0887b88685d97bf
Sep 12 02:53:39.740102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.740070    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:39.740208 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.740132    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:39.740208 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:39.740160    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:53:40.161648 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.161622    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b" path="/var/lib/kubelet/pods/5d1a075f-9bc1-4e4f-a6e9-00d7299a8b1b/volumes"
Sep 12 02:53:40.161995 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.161961    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60304b43-f8a4-441c-8f82-d30de695006d" path="/var/lib/kubelet/pods/60304b43-f8a4-441c-8f82-d30de695006d/volumes"
Sep 12 02:53:40.313870 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.313830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" event={"ID":"4194b08f-c2b7-4f62-a464-13bf0f6ddf19","Type":"ContainerStarted","Data":"40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"}
Sep 12 02:53:40.314057 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.313900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" event={"ID":"4194b08f-c2b7-4f62-a464-13bf0f6ddf19","Type":"ContainerStarted","Data":"dbe88088222a4c134c97c851e918c3a5fae45bb7ee409babc0887b88685d97bf"}
Sep 12 02:53:40.336197 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.336137    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podStartSLOduration=1.336120482 podStartE2EDuration="1.336120482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:53:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:53:40.334948071 +0000 UTC m=+1052.590929111" watchObservedRunningTime="2026-09-12 02:53:40.336120482 +0000 UTC m=+1052.592101497"
Sep 12 02:53:40.433852 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.433780    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:40.439271 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:40.439248    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:41.322244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:41.322209    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:41.323180 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:41.323160    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:53:43.627201 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.627143    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:43.750797 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.750760    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istiod-ca-cert\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.750946 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.750815    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-podinfo\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.750946 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.750846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-data\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.750946 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.750876    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-certs\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.750946 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.750933    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-token\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.751167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.750966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-socket\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.751167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751002    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b685g\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-kube-api-access-b685g\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.751167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-envoy\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.751321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751167    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-credential-socket\") pod \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\" (UID: \"f9dd04e3-bebe-41d1-acf0-34e46b5d422b\") "
Sep 12 02:53:43.751321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751194    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:53:43.751321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751195    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:43.751321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751282    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:43.751321 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:43.751622 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751566    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:43.751622 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751605    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.751727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751623    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.751727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751635    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.751727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.751650    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.753255 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.753227    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:53:43.753379 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.753351    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-kube-api-access-b685g" (OuterVolumeSpecName: "kube-api-access-b685g") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "kube-api-access-b685g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:53:43.753530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.753511    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:53:43.753604 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.753587    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9dd04e3-bebe-41d1-acf0-34e46b5d422b" (UID: "f9dd04e3-bebe-41d1-acf0-34e46b5d422b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:53:43.852354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.852321    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.852354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.852352    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.852545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.852366    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b685g\" (UniqueName: \"kubernetes.io/projected/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-kube-api-access-b685g\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.852545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.852379    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.852545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.852393    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9dd04e3-bebe-41d1-acf0-34e46b5d422b-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:53:43.877153 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.877122    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"]
Sep 12 02:53:43.877870 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.877825    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy"
Sep 12 02:53:43.877870 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.877848    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy"
Sep 12 02:53:43.877951 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.877878    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy"
Sep 12 02:53:43.877951 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.877886    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy"
Sep 12 02:53:43.878015 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.877983    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy"
Sep 12 02:53:43.881693 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.881675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:43.883954 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.883930    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-1ac5b7fd-dockercfg-tvbjk\""
Sep 12 02:53:43.884268 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.884252    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-1ac5b7fd\""
Sep 12 02:53:43.891719 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.891698    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"]
Sep 12 02:53:43.899771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.899749    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"]
Sep 12 02:53:43.900741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.900722    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerName="istio-proxy"
Sep 12 02:53:43.903842 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.903824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:43.913804 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.913769    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"]
Sep 12 02:53:43.953536 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.953514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4r2q\" (UniqueName: \"kubernetes.io/projected/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-kube-api-access-p4r2q\") pod \"payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") " pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:43.953637 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.953580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e7e8d8f-fed9-4482-9479-d01611aa0454-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:43.953637 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.953611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-plugins-config-volume\") pod \"payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") " pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:43.953745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:43.953650    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l5qf\" (UniqueName: \"kubernetes.io/projected/0e7e8d8f-fed9-4482-9479-d01611aa0454-kube-api-access-5l5qf\") pod \"payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:44.054335 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.054299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4r2q\" (UniqueName: \"kubernetes.io/projected/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-kube-api-access-p4r2q\") pod \"payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") " pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:44.054537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.054375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e7e8d8f-fed9-4482-9479-d01611aa0454-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:44.054537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.054431    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-plugins-config-volume\") pod \"payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") " pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:44.054537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.054483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l5qf\" (UniqueName: \"kubernetes.io/projected/0e7e8d8f-fed9-4482-9479-d01611aa0454-kube-api-access-5l5qf\") pod \"payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:44.055140 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.055118    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e7e8d8f-fed9-4482-9479-d01611aa0454-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:44.055189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.055145    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-plugins-config-volume\") pod \"payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") " pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:44.062141 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.062113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4r2q\" (UniqueName: \"kubernetes.io/projected/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-kube-api-access-p4r2q\") pod \"payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") " pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:44.062248 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.062203    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l5qf\" (UniqueName: \"kubernetes.io/projected/0e7e8d8f-fed9-4482-9479-d01611aa0454-kube-api-access-5l5qf\") pod \"payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:44.194252 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.194222    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:44.214922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.214897    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:44.342284 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.342251    2583 generic.go:356] "Generic (PLEG): container finished" podID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" containerID="0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201" exitCode=0
Sep 12 02:53:44.342440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.342313    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" event={"ID":"f9dd04e3-bebe-41d1-acf0-34e46b5d422b","Type":"ContainerDied","Data":"0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201"}
Sep 12 02:53:44.342440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.342321    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"
Sep 12 02:53:44.342440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.342369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb" event={"ID":"f9dd04e3-bebe-41d1-acf0-34e46b5d422b","Type":"ContainerDied","Data":"faa32c94f4ebb8171b3f4bb1359a2cbf8f138cff093c58d7d1a94f191e272626"}
Sep 12 02:53:44.342440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.342400    2583 scope.go:117] "RemoveContainer" containerID="0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201"
Sep 12 02:53:44.352022 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.352006    2583 scope.go:117] "RemoveContainer" containerID="47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"
Sep 12 02:53:44.360348 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.360329    2583 scope.go:117] "RemoveContainer" containerID="0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201"
Sep 12 02:53:44.360642 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:53:44.360623    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201\": container with ID starting with 0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201 not found: ID does not exist" containerID="0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201"
Sep 12 02:53:44.360714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.360655    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201"} err="failed to get container status \"0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201\": rpc error: code = NotFound desc = could not find container \"0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201\": container with ID starting with 0390946b821e5883a81473b1fcfb032689f6f4d7f467fbcef8356bd739e17201 not found: ID does not exist"
Sep 12 02:53:44.360714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.360677    2583 scope.go:117] "RemoveContainer" containerID="47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"
Sep 12 02:53:44.360949 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:53:44.360932    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c\": container with ID starting with 47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c not found: ID does not exist" containerID="47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"
Sep 12 02:53:44.360991 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.360955    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c"} err="failed to get container status \"47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c\": rpc error: code = NotFound desc = could not find container \"47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c\": container with ID starting with 47f5a9c5c6a32c977856f321c8e86cb1d34611113ba41f0954fe80f23f0f523c not found: ID does not exist"
Sep 12 02:53:44.366034 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.366006    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"]
Sep 12 02:53:44.369269 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.369250    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-03cd9838-gw-openshift-default-65888b688-6x2mb"]
Sep 12 02:53:44.471581 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.471551    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"]
Sep 12 02:53:44.472049 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:53:44.472026    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e7e8d8f_fed9_4482_9479_d01611aa0454.slice/crio-a7a2aab338d666e0765ded7cea0e59d69241f7c4add861c11289751fb97618f6 WatchSource:0}: Error finding container a7a2aab338d666e0765ded7cea0e59d69241f7c4add861c11289751fb97618f6: Status 404 returned error can't find the container with id a7a2aab338d666e0765ded7cea0e59d69241f7c4add861c11289751fb97618f6
Sep 12 02:53:44.503938 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:44.503918    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"]
Sep 12 02:53:44.509574 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:53:44.509552    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee7cdfd_51b8_4118_ac5f_11f3acaf6086.slice/crio-d4c0849a0c954cb9c7871c4d2447ee68c1eec135ed2240ce02f30926d7dccee8 WatchSource:0}: Error finding container d4c0849a0c954cb9c7871c4d2447ee68c1eec135ed2240ce02f30926d7dccee8: Status 404 returned error can't find the container with id d4c0849a0c954cb9c7871c4d2447ee68c1eec135ed2240ce02f30926d7dccee8
Sep 12 02:53:45.350801 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.350753    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf" event={"ID":"0e7e8d8f-fed9-4482-9479-d01611aa0454","Type":"ContainerStarted","Data":"3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa"}
Sep 12 02:53:45.351242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.350822    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf" event={"ID":"0e7e8d8f-fed9-4482-9479-d01611aa0454","Type":"ContainerStarted","Data":"a7a2aab338d666e0765ded7cea0e59d69241f7c4add861c11289751fb97618f6"}
Sep 12 02:53:45.351242 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.350854    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:53:45.353333 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.353300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4" event={"ID":"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086","Type":"ContainerStarted","Data":"e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb"}
Sep 12 02:53:45.353486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.353356    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:45.353486 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.353372    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4" event={"ID":"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086","Type":"ContainerStarted","Data":"d4c0849a0c954cb9c7871c4d2447ee68c1eec135ed2240ce02f30926d7dccee8"}
Sep 12 02:53:45.366012 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.365973    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf" podStartSLOduration=2.365960723 podStartE2EDuration="2.365960723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:53:45.364780722 +0000 UTC m=+1057.620761747" watchObservedRunningTime="2026-09-12 02:53:45.365960723 +0000 UTC m=+1057.621941772"
Sep 12 02:53:45.382105 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:45.382066    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4" podStartSLOduration=2.382051776 podStartE2EDuration="2.382051776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:53:45.378759785 +0000 UTC m=+1057.634740799" watchObservedRunningTime="2026-09-12 02:53:45.382051776 +0000 UTC m=+1057.638032788"
Sep 12 02:53:46.162041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:46.162012    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9dd04e3-bebe-41d1-acf0-34e46b5d422b" path="/var/lib/kubelet/pods/f9dd04e3-bebe-41d1-acf0-34e46b5d422b/volumes"
Sep 12 02:53:56.361298 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:56.361260    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:53:56.361774 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:53:56.361351    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:54:04.490244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:04.490210    2583 generic.go:356] "Generic (PLEG): container finished" podID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerID="40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f" exitCode=0
Sep 12 02:54:04.490783 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:04.490281    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" event={"ID":"4194b08f-c2b7-4f62-a464-13bf0f6ddf19","Type":"ContainerDied","Data":"40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"}
Sep 12 02:54:04.490882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:04.490866    2583 scope.go:117] "RemoveContainer" containerID="40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"
Sep 12 02:54:04.492595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:04.492568    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:04.492714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:04.492635    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:04.492714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:04.492667    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:05.498919 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:05.498885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" event={"ID":"4194b08f-c2b7-4f62-a464-13bf0f6ddf19","Type":"ContainerStarted","Data":"30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299"}
Sep 12 02:54:06.434011 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:06.433977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:54:06.434188 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:06.434168    2583 patch_prober.go:28] interesting pod/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 12 02:54:06.434235 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:06.434216    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 12 02:54:07.434223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.434181    2583 patch_prober.go:28] interesting pod/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 12 02:54:07.434650 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.434255    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 12 02:54:07.515734 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.515694    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"]
Sep 12 02:54:07.520221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.520192    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:07.528602 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.528574    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:54:07.529204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.529180    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:54:07.530600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.530573    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"]
Sep 12 02:54:07.593523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.593490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1294bc1-0952-4780-acc6-f2bf22fa07a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7\" (UID: \"d1294bc1-0952-4780-acc6-f2bf22fa07a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:07.695057 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.694987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1294bc1-0952-4780-acc6-f2bf22fa07a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7\" (UID: \"d1294bc1-0952-4780-acc6-f2bf22fa07a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:07.695610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.695591    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1294bc1-0952-4780-acc6-f2bf22fa07a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7\" (UID: \"d1294bc1-0952-4780-acc6-f2bf22fa07a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:07.849501 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:07.849470    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:08.129336 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:08.129311    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"]
Sep 12 02:54:08.131488 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:54:08.131455    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1294bc1_0952_4780_acc6_f2bf22fa07a5.slice/crio-b1e84869f7f72e666684762fd3f66742e21ce9f3bf8cd492a85435306ab29301 WatchSource:0}: Error finding container b1e84869f7f72e666684762fd3f66742e21ce9f3bf8cd492a85435306ab29301: Status 404 returned error can't find the container with id b1e84869f7f72e666684762fd3f66742e21ce9f3bf8cd492a85435306ab29301
Sep 12 02:54:08.433982 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:08.433950    2583 patch_prober.go:28] interesting pod/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 12 02:54:08.434165 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:08.434000    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 12 02:54:08.532130 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:08.532100    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7" event={"ID":"d1294bc1-0952-4780-acc6-f2bf22fa07a5","Type":"ContainerStarted","Data":"b1e84869f7f72e666684762fd3f66742e21ce9f3bf8cd492a85435306ab29301"}
Sep 12 02:54:09.434377 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:09.434343    2583 patch_prober.go:28] interesting pod/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 12 02:54:09.434588 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:09.434396    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 12 02:54:09.545949 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:09.545911    2583 generic.go:356] "Generic (PLEG): container finished" podID="d1294bc1-0952-4780-acc6-f2bf22fa07a5" containerID="319aef3153e4b1af4096773cca449f6d9dd91f3e3395ce1fc552975cde412d54" exitCode=0
Sep 12 02:54:09.546354 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:09.545996    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7" event={"ID":"d1294bc1-0952-4780-acc6-f2bf22fa07a5","Type":"ContainerDied","Data":"319aef3153e4b1af4096773cca449f6d9dd91f3e3395ce1fc552975cde412d54"}
Sep 12 02:54:10.434629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:10.434590    2583 patch_prober.go:28] interesting pod/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Sep 12 02:54:10.434823 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:10.434650    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Sep 12 02:54:10.709892 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:10.709866    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:10.838347 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:10.838313    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1294bc1-0952-4780-acc6-f2bf22fa07a5-maas-api-service-ca\") pod \"d1294bc1-0952-4780-acc6-f2bf22fa07a5\" (UID: \"d1294bc1-0952-4780-acc6-f2bf22fa07a5\") "
Sep 12 02:54:10.838677 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:10.838651    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1294bc1-0952-4780-acc6-f2bf22fa07a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1294bc1-0952-4780-acc6-f2bf22fa07a5" (UID: "d1294bc1-0952-4780-acc6-f2bf22fa07a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:54:10.838803 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:10.838775    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1294bc1-0952-4780-acc6-f2bf22fa07a5-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:11.322370 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:11.322335    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:54:11.438080 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:11.438052    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:54:11.561119 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:11.561090    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"
Sep 12 02:54:11.561119 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:11.561105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7" event={"ID":"d1294bc1-0952-4780-acc6-f2bf22fa07a5","Type":"ContainerDied","Data":"b1e84869f7f72e666684762fd3f66742e21ce9f3bf8cd492a85435306ab29301"}
Sep 12 02:54:11.561312 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:11.561160    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1e84869f7f72e666684762fd3f66742e21ce9f3bf8cd492a85435306ab29301"
Sep 12 02:54:11.562186 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:11.562164    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:54:13.622346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.622311    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"]
Sep 12 02:54:13.622741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.622552    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4" podUID="9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" containerName="payload-processing" containerID="cri-o://e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb" gracePeriod=30
Sep 12 02:54:13.629191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.629164    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"]
Sep 12 02:54:13.629432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.629366    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf" podUID="0e7e8d8f-fed9-4482-9479-d01611aa0454" containerName="payload-pre-processing" containerID="cri-o://3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa" gracePeriod=30
Sep 12 02:54:13.786594 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.786562    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"]
Sep 12 02:54:13.791882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.791637    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-1ac5b7fd-2m8z7"]
Sep 12 02:54:13.898260 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.898235    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:54:13.924250 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:13.924217    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:54:14.069703 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.069679    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e7e8d8f-fed9-4482-9479-d01611aa0454-plugins-config-volume\") pod \"0e7e8d8f-fed9-4482-9479-d01611aa0454\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") "
Sep 12 02:54:14.069876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.069717    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-plugins-config-volume\") pod \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") "
Sep 12 02:54:14.069876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.069761    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4r2q\" (UniqueName: \"kubernetes.io/projected/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-kube-api-access-p4r2q\") pod \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\" (UID: \"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086\") "
Sep 12 02:54:14.069876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.069777    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l5qf\" (UniqueName: \"kubernetes.io/projected/0e7e8d8f-fed9-4482-9479-d01611aa0454-kube-api-access-5l5qf\") pod \"0e7e8d8f-fed9-4482-9479-d01611aa0454\" (UID: \"0e7e8d8f-fed9-4482-9479-d01611aa0454\") "
Sep 12 02:54:14.070165 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.070136    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" (UID: "9ee7cdfd-51b8-4118-ac5f-11f3acaf6086"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:54:14.070247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.070170    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e7e8d8f-fed9-4482-9479-d01611aa0454-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e7e8d8f-fed9-4482-9479-d01611aa0454" (UID: "0e7e8d8f-fed9-4482-9479-d01611aa0454"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:54:14.071964 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.071936    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-kube-api-access-p4r2q" (OuterVolumeSpecName: "kube-api-access-p4r2q") pod "9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" (UID: "9ee7cdfd-51b8-4118-ac5f-11f3acaf6086"). InnerVolumeSpecName "kube-api-access-p4r2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:54:14.072056 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.071969    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e7e8d8f-fed9-4482-9479-d01611aa0454-kube-api-access-5l5qf" (OuterVolumeSpecName: "kube-api-access-5l5qf") pod "0e7e8d8f-fed9-4482-9479-d01611aa0454" (UID: "0e7e8d8f-fed9-4482-9479-d01611aa0454"). InnerVolumeSpecName "kube-api-access-5l5qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:54:14.161755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.161723    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1294bc1-0952-4780-acc6-f2bf22fa07a5" path="/var/lib/kubelet/pods/d1294bc1-0952-4780-acc6-f2bf22fa07a5/volumes"
Sep 12 02:54:14.170688 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.170666    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e7e8d8f-fed9-4482-9479-d01611aa0454-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:14.170793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.170693    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:14.170793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.170702    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4r2q\" (UniqueName: \"kubernetes.io/projected/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086-kube-api-access-p4r2q\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:14.170793 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.170711    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l5qf\" (UniqueName: \"kubernetes.io/projected/0e7e8d8f-fed9-4482-9479-d01611aa0454-kube-api-access-5l5qf\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:14.586417 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.586367    2583 generic.go:356] "Generic (PLEG): container finished" podID="9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" containerID="e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb" exitCode=0
Sep 12 02:54:14.586600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.586437    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"
Sep 12 02:54:14.586600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.586454    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4" event={"ID":"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086","Type":"ContainerDied","Data":"e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb"}
Sep 12 02:54:14.586600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.586509    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4" event={"ID":"9ee7cdfd-51b8-4118-ac5f-11f3acaf6086","Type":"ContainerDied","Data":"d4c0849a0c954cb9c7871c4d2447ee68c1eec135ed2240ce02f30926d7dccee8"}
Sep 12 02:54:14.586600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.586535    2583 scope.go:117] "RemoveContainer" containerID="e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb"
Sep 12 02:54:14.588041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.588020    2583 generic.go:356] "Generic (PLEG): container finished" podID="0e7e8d8f-fed9-4482-9479-d01611aa0454" containerID="3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa" exitCode=0
Sep 12 02:54:14.588154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.588082    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"
Sep 12 02:54:14.588154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.588097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf" event={"ID":"0e7e8d8f-fed9-4482-9479-d01611aa0454","Type":"ContainerDied","Data":"3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa"}
Sep 12 02:54:14.588154 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.588139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf" event={"ID":"0e7e8d8f-fed9-4482-9479-d01611aa0454","Type":"ContainerDied","Data":"a7a2aab338d666e0765ded7cea0e59d69241f7c4add861c11289751fb97618f6"}
Sep 12 02:54:14.597282 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.597268    2583 scope.go:117] "RemoveContainer" containerID="e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb"
Sep 12 02:54:14.597589 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:54:14.597563    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb\": container with ID starting with e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb not found: ID does not exist" containerID="e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb"
Sep 12 02:54:14.597650 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.597599    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb"} err="failed to get container status \"e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb\": rpc error: code = NotFound desc = could not find container \"e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb\": container with ID starting with e856ab27ddf388c970738ee48d216d4582fd122a832e17fecf0fa5971c056fdb not found: ID does not exist"
Sep 12 02:54:14.597650 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.597616    2583 scope.go:117] "RemoveContainer" containerID="3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa"
Sep 12 02:54:14.609523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.606235    2583 scope.go:117] "RemoveContainer" containerID="3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa"
Sep 12 02:54:14.609523 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:54:14.606573    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa\": container with ID starting with 3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa not found: ID does not exist" containerID="3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa"
Sep 12 02:54:14.609523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.606607    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa"} err="failed to get container status \"3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa\": rpc error: code = NotFound desc = could not find container \"3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa\": container with ID starting with 3c94cca0e57409982798ea46384fecef4aa57301f8c64e3e3fae530f53ff77aa not found: ID does not exist"
Sep 12 02:54:14.613679 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.613644    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"]
Sep 12 02:54:14.616014 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.615992    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-1ac5b7fd-f94cfdd6b-gbnkf"]
Sep 12 02:54:14.620948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.620928    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"]
Sep 12 02:54:14.626346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:14.626325    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-1ac5b7fd-864bf55bbf-f7pd4"]
Sep 12 02:54:15.003395 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.003307    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"]
Sep 12 02:54:15.003642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.003602    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy" containerID="cri-o://30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299" gracePeriod=30
Sep 12 02:54:15.779909 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.779877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"]
Sep 12 02:54:15.780358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780345    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1294bc1-0952-4780-acc6-f2bf22fa07a5" containerName="revoke-keys"
Sep 12 02:54:15.780358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780359    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1294bc1-0952-4780-acc6-f2bf22fa07a5" containerName="revoke-keys"
Sep 12 02:54:15.780466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780375    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" containerName="payload-processing"
Sep 12 02:54:15.780466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780381    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" containerName="payload-processing"
Sep 12 02:54:15.780466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780393    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e7e8d8f-fed9-4482-9479-d01611aa0454" containerName="payload-pre-processing"
Sep 12 02:54:15.780466 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780399    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e7e8d8f-fed9-4482-9479-d01611aa0454" containerName="payload-pre-processing"
Sep 12 02:54:15.780607 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780505    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1294bc1-0952-4780-acc6-f2bf22fa07a5" containerName="revoke-keys"
Sep 12 02:54:15.780607 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780517    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e7e8d8f-fed9-4482-9479-d01611aa0454" containerName="payload-pre-processing"
Sep 12 02:54:15.780607 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.780526    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" containerName="payload-processing"
Sep 12 02:54:15.785431 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.785399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.787759 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.787741    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bc3f9c2f-openshift-default-dockercfg-9n6fj\""
Sep 12 02:54:15.798146 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.798123    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"]
Sep 12 02:54:15.886663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.886628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-podinfo\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.886853 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.886722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-credential-socket\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.886853 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.886771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-socket\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.886853 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.886830    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-envoy\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.887035 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.886852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-token\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.887035 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.886947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-certs\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.887035 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.887007    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zncv\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-kube-api-access-7zncv\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.887182 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.887115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-data\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.887235 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.887187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istiod-ca-cert\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.987867 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.987833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-podinfo\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.987873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-credential-socket\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.987897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-socket\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.987921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-envoy\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.987937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-token\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.987980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-certs\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988055 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zncv\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-kube-api-access-7zncv\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988390 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-data\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988390 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istiod-ca-cert\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988390 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988286    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-credential-socket\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988390 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988338    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-certs\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988390 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-socket\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988700 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-data\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.988853 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.988817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istiod-ca-cert\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.990656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.990630    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-envoy\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.990800 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.990783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-podinfo\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.995506 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.995487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-token\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:15.995657 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:15.995641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zncv\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-kube-api-access-7zncv\") pod \"e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") " pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:16.100510 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.100483    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:16.168125 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.168080    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e7e8d8f-fed9-4482-9479-d01611aa0454" path="/var/lib/kubelet/pods/0e7e8d8f-fed9-4482-9479-d01611aa0454/volumes"
Sep 12 02:54:16.169047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.169018    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ee7cdfd-51b8-4118-ac5f-11f3acaf6086" path="/var/lib/kubelet/pods/9ee7cdfd-51b8-4118-ac5f-11f3acaf6086/volumes"
Sep 12 02:54:16.377773 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.377740    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"]
Sep 12 02:54:16.378734 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:54:16.378705    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6ce3db_9cd6_4c3a_aac7_681b7e6a8ba2.slice/crio-f99b86156539ece3ed10c210bf01d6873f98de18105fb2587924e895b55f0041 WatchSource:0}: Error finding container f99b86156539ece3ed10c210bf01d6873f98de18105fb2587924e895b55f0041: Status 404 returned error can't find the container with id f99b86156539ece3ed10c210bf01d6873f98de18105fb2587924e895b55f0041
Sep 12 02:54:16.380975 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.380942    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:16.381102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.381018    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:16.381102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.381061    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:16.606637 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.606596    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" event={"ID":"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2","Type":"ContainerStarted","Data":"37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"}
Sep 12 02:54:16.606839 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.606669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" event={"ID":"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2","Type":"ContainerStarted","Data":"f99b86156539ece3ed10c210bf01d6873f98de18105fb2587924e895b55f0041"}
Sep 12 02:54:16.628669 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:16.628564    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podStartSLOduration=1.6285444839999998 podStartE2EDuration="1.628544484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:54:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:54:16.624545625 +0000 UTC m=+1088.880526654" watchObservedRunningTime="2026-09-12 02:54:16.628544484 +0000 UTC m=+1088.884525500"
Sep 12 02:54:17.101019 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:17.100989    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:17.102680 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:17.102648    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:17.102829 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:17.102700    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:18.106005 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:18.105962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:18.618684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:18.618647    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:18.619471 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:18.619453    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:20.268006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.267957    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:54:20.334528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334496    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-credential-socket\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.334706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334539    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-podinfo\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.334706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334557    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istiod-ca-cert\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.334706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334572    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-socket\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.334706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334591    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-envoy\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.334706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334658    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxrx\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-kube-api-access-wtxrx\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.334706 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334680    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-certs\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.335025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334731    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-token\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.335025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334770    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-data\") pod \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\" (UID: \"4194b08f-c2b7-4f62-a464-13bf0f6ddf19\") "
Sep 12 02:54:20.335025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334865    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:54:20.335025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334880    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:54:20.335025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.334923    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:54:20.335262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.335120    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:54:20.335262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.335202    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.335262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.335223    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.335262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.335237    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.335262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.335250    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.335544 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.335352    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-data" (OuterVolumeSpecName: "istio-data") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:54:20.336934 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.336910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-token" (OuterVolumeSpecName: "istio-token") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:54:20.337033 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.336910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:54:20.337195 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.337168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:54:20.337288 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.337189    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-kube-api-access-wtxrx" (OuterVolumeSpecName: "kube-api-access-wtxrx") pod "4194b08f-c2b7-4f62-a464-13bf0f6ddf19" (UID: "4194b08f-c2b7-4f62-a464-13bf0f6ddf19"). InnerVolumeSpecName "kube-api-access-wtxrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:54:20.435874 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.435845    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.435874 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.435872    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.436044 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.435882    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxrx\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-kube-api-access-wtxrx\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.436044 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.435893    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.436044 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.435902    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4194b08f-c2b7-4f62-a464-13bf0f6ddf19-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:20.632310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.632280    2583 generic.go:356] "Generic (PLEG): container finished" podID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerID="30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299" exitCode=0
Sep 12 02:54:20.632489 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.632330    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"
Sep 12 02:54:20.632489 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.632359    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" event={"ID":"4194b08f-c2b7-4f62-a464-13bf0f6ddf19","Type":"ContainerDied","Data":"30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299"}
Sep 12 02:54:20.632489 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.632456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7" event={"ID":"4194b08f-c2b7-4f62-a464-13bf0f6ddf19","Type":"ContainerDied","Data":"dbe88088222a4c134c97c851e918c3a5fae45bb7ee409babc0887b88685d97bf"}
Sep 12 02:54:20.632489 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.632481    2583 scope.go:117] "RemoveContainer" containerID="30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299"
Sep 12 02:54:20.642800 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.642783    2583 scope.go:117] "RemoveContainer" containerID="40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"
Sep 12 02:54:20.651049 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.651033    2583 scope.go:117] "RemoveContainer" containerID="30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299"
Sep 12 02:54:20.651346 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:54:20.651320    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299\": container with ID starting with 30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299 not found: ID does not exist" containerID="30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299"
Sep 12 02:54:20.651456 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.651353    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299"} err="failed to get container status \"30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299\": rpc error: code = NotFound desc = could not find container \"30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299\": container with ID starting with 30a89050b98f4979d1b1a3c8a387f6f3eb965cf0379f0b75ceeaa54ef244f299 not found: ID does not exist"
Sep 12 02:54:20.651456 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.651368    2583 scope.go:117] "RemoveContainer" containerID="40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"
Sep 12 02:54:20.651663 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:54:20.651636    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f\": container with ID starting with 40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f not found: ID does not exist" containerID="40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"
Sep 12 02:54:20.651761 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.651669    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f"} err="failed to get container status \"40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f\": rpc error: code = NotFound desc = could not find container \"40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f\": container with ID starting with 40a910b0c2d15431ce91d9206ec851bf9d8812de8ab18f866db9613fa5f2443f not found: ID does not exist"
Sep 12 02:54:20.654861 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.654840    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"]
Sep 12 02:54:20.658589 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:20.658570    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1ac5b7fd-openshift-default-799bc65c58-prhw7"]
Sep 12 02:54:22.166641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.166609    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" path="/var/lib/kubelet/pods/4194b08f-c2b7-4f62-a464-13bf0f6ddf19/volumes"
Sep 12 02:54:22.896324 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896291    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"]
Sep 12 02:54:22.896745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896732    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy"
Sep 12 02:54:22.896791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896746    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy"
Sep 12 02:54:22.896791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896778    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy"
Sep 12 02:54:22.896791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896784    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy"
Sep 12 02:54:22.896900 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896858    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy"
Sep 12 02:54:22.896900 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.896868    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4194b08f-c2b7-4f62-a464-13bf0f6ddf19" containerName="istio-proxy"
Sep 12 02:54:22.901481 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.901463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:22.903766 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.903748    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-bc3f9c2f\""
Sep 12 02:54:22.903853 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.903791    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-bc3f9c2f-dockercfg-nqwjr\""
Sep 12 02:54:22.910451 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.910431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"]
Sep 12 02:54:22.936192 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.936171    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"]
Sep 12 02:54:22.939721 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.939707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:22.950657 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.950639    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"]
Sep 12 02:54:22.957656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.957635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-plugins-config-volume\") pod \"payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") " pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:22.957749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.957670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26cwr\" (UniqueName: \"kubernetes.io/projected/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-kube-api-access-26cwr\") pod \"payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") " pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:22.957749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.957696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e25d626-3025-4681-a91e-4bafe7930c6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:22.957835 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:22.957779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9bmv\" (UniqueName: \"kubernetes.io/projected/3e25d626-3025-4681-a91e-4bafe7930c6c-kube-api-access-n9bmv\") pod \"payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.059378 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.059345    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-plugins-config-volume\") pod \"payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") " pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:23.059554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.059387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26cwr\" (UniqueName: \"kubernetes.io/projected/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-kube-api-access-26cwr\") pod \"payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") " pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:23.059554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.059435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e25d626-3025-4681-a91e-4bafe7930c6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.059554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.059465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9bmv\" (UniqueName: \"kubernetes.io/projected/3e25d626-3025-4681-a91e-4bafe7930c6c-kube-api-access-n9bmv\") pod \"payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.060051 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.060033    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-plugins-config-volume\") pod \"payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") " pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:23.060148 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.060129    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e25d626-3025-4681-a91e-4bafe7930c6c-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.067131 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.067106    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9bmv\" (UniqueName: \"kubernetes.io/projected/3e25d626-3025-4681-a91e-4bafe7930c6c-kube-api-access-n9bmv\") pod \"payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.067257 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.067240    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26cwr\" (UniqueName: \"kubernetes.io/projected/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-kube-api-access-26cwr\") pod \"payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") " pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:23.212682 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.212599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.249854 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.249819    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:23.482620 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.482594    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"]
Sep 12 02:54:23.483221 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:54:23.483197    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e25d626_3025_4681_a91e_4bafe7930c6c.slice/crio-2a5d006914e53b4278dcc61823c45f9eb04d15ee78b1813ca3ae7ad99172ca1b WatchSource:0}: Error finding container 2a5d006914e53b4278dcc61823c45f9eb04d15ee78b1813ca3ae7ad99172ca1b: Status 404 returned error can't find the container with id 2a5d006914e53b4278dcc61823c45f9eb04d15ee78b1813ca3ae7ad99172ca1b
Sep 12 02:54:23.531216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.531193    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"]
Sep 12 02:54:23.537461 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:54:23.537438    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f10cf6_60c6_42f1_96a9_aaf476f166f5.slice/crio-6455b2db8742d135b4ec280c163c438a2e3ec5a3e118bcabef7ec394425bf061 WatchSource:0}: Error finding container 6455b2db8742d135b4ec280c163c438a2e3ec5a3e118bcabef7ec394425bf061: Status 404 returned error can't find the container with id 6455b2db8742d135b4ec280c163c438a2e3ec5a3e118bcabef7ec394425bf061
Sep 12 02:54:23.654979 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.654942    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln" event={"ID":"a0f10cf6-60c6-42f1-96a9-aaf476f166f5","Type":"ContainerStarted","Data":"9ab532868b69fa5f6b6fa679b8b935bccfbb7aa7293fb46eae28b54eaee5221b"}
Sep 12 02:54:23.655146 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.655006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln" event={"ID":"a0f10cf6-60c6-42f1-96a9-aaf476f166f5","Type":"ContainerStarted","Data":"6455b2db8742d135b4ec280c163c438a2e3ec5a3e118bcabef7ec394425bf061"}
Sep 12 02:54:23.655146 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.655036    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:23.656762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.656731    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r" event={"ID":"3e25d626-3025-4681-a91e-4bafe7930c6c","Type":"ContainerStarted","Data":"63cb2f208c74d9fff60347220d6b1f68147742d318e9d1ca3f68550dccbb3d11"}
Sep 12 02:54:23.656885 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.656785    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r" event={"ID":"3e25d626-3025-4681-a91e-4bafe7930c6c","Type":"ContainerStarted","Data":"2a5d006914e53b4278dcc61823c45f9eb04d15ee78b1813ca3ae7ad99172ca1b"}
Sep 12 02:54:23.656885 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.656827    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:23.675782 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.675738    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln" podStartSLOduration=1.675725251 podStartE2EDuration="1.675725251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:54:23.672496626 +0000 UTC m=+1095.928477641" watchObservedRunningTime="2026-09-12 02:54:23.675725251 +0000 UTC m=+1095.931706266"
Sep 12 02:54:23.689809 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:23.689771    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r" podStartSLOduration=1.689761167 podStartE2EDuration="1.689761167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:54:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:54:23.68759889 +0000 UTC m=+1095.943579906" watchObservedRunningTime="2026-09-12 02:54:23.689761167 +0000 UTC m=+1095.945742181"
Sep 12 02:54:34.664588 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:34.664553    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:54:34.665132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:34.664635    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:54:42.787949 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:42.787854    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerID="37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520" exitCode=0
Sep 12 02:54:42.787949 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:42.787889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" event={"ID":"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2","Type":"ContainerDied","Data":"37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"}
Sep 12 02:54:42.788358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:42.788218    2583 scope.go:117] "RemoveContainer" containerID="37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"
Sep 12 02:54:42.789427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:42.789381    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:42.789487 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:42.789471    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:42.789523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:42.789502    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:54:43.799039 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:43.799000    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" event={"ID":"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2","Type":"ContainerStarted","Data":"32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62"}
Sep 12 02:54:44.102500 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:44.102460    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:44.102842 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:44.102816    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:44.103016 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:44.102994    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:45.101280 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:45.101240    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:45.101814 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:45.101313    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:46.100901 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:46.100861    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:46.101191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:46.101162    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:47.101041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:47.101001    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:47.101641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:47.101608    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:47.990208 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:47.990156    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"]
Sep 12 02:54:47.994143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:47.994119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:47.997013 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:47.996889    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:54:47.997013 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:47.996889    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:54:48.000444 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.000398    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"]
Sep 12 02:54:48.108477 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.108435    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:48.108946 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.108499    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:48.119615 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.119580    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3194f-3ca7-4c77-acc2-d4a452b81996-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4\" (UID: \"7cb3194f-3ca7-4c77-acc2-d4a452b81996\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:48.221041 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.220996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3194f-3ca7-4c77-acc2-d4a452b81996-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4\" (UID: \"7cb3194f-3ca7-4c77-acc2-d4a452b81996\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:48.221909 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.221879    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3194f-3ca7-4c77-acc2-d4a452b81996-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4\" (UID: \"7cb3194f-3ca7-4c77-acc2-d4a452b81996\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:48.309115 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.309022    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:48.592611 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:54:48.592579    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb3194f_3ca7_4c77_acc2_d4a452b81996.slice/crio-d1a2a1d3de2d44d29cbf60584834135fdef4c7438f12e5b674b13e0f031fcb42 WatchSource:0}: Error finding container d1a2a1d3de2d44d29cbf60584834135fdef4c7438f12e5b674b13e0f031fcb42: Status 404 returned error can't find the container with id d1a2a1d3de2d44d29cbf60584834135fdef4c7438f12e5b674b13e0f031fcb42
Sep 12 02:54:48.635180 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.623528    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:48.635180 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.631204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"]
Sep 12 02:54:48.850808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:48.850727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4" event={"ID":"7cb3194f-3ca7-4c77-acc2-d4a452b81996","Type":"ContainerStarted","Data":"d1a2a1d3de2d44d29cbf60584834135fdef4c7438f12e5b674b13e0f031fcb42"}
Sep 12 02:54:49.101442 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:49.101323    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 12 02:54:49.101672 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:49.101641    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 12 02:54:49.858469 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:49.858357    2583 generic.go:356] "Generic (PLEG): container finished" podID="7cb3194f-3ca7-4c77-acc2-d4a452b81996" containerID="bb655cf541d1b897cbf7157023d0d9fafb80bd227846f7ede49302ccd9ad325f" exitCode=0
Sep 12 02:54:49.858469 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:49.858451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4" event={"ID":"7cb3194f-3ca7-4c77-acc2-d4a452b81996","Type":"ContainerDied","Data":"bb655cf541d1b897cbf7157023d0d9fafb80bd227846f7ede49302ccd9ad325f"}
Sep 12 02:54:50.106007 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:50.105977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:50.106935 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:50.106917    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:54:51.007559 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.007535    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:51.156528 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.156449    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3194f-3ca7-4c77-acc2-d4a452b81996-maas-api-service-ca\") pod \"7cb3194f-3ca7-4c77-acc2-d4a452b81996\" (UID: \"7cb3194f-3ca7-4c77-acc2-d4a452b81996\") "
Sep 12 02:54:51.156966 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.156938    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cb3194f-3ca7-4c77-acc2-d4a452b81996-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7cb3194f-3ca7-4c77-acc2-d4a452b81996" (UID: "7cb3194f-3ca7-4c77-acc2-d4a452b81996"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:54:51.258279 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.258249    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cb3194f-3ca7-4c77-acc2-d4a452b81996-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:54:51.871262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.871223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4" event={"ID":"7cb3194f-3ca7-4c77-acc2-d4a452b81996","Type":"ContainerDied","Data":"d1a2a1d3de2d44d29cbf60584834135fdef4c7438f12e5b674b13e0f031fcb42"}
Sep 12 02:54:51.871262 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.871251    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"
Sep 12 02:54:51.871492 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:51.871278    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1a2a1d3de2d44d29cbf60584834135fdef4c7438f12e5b674b13e0f031fcb42"
Sep 12 02:54:59.955996 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.955964    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"]
Sep 12 02:54:59.956458 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.956445    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb3194f-3ca7-4c77-acc2-d4a452b81996" containerName="revoke-keys"
Sep 12 02:54:59.956458 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.956459    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb3194f-3ca7-4c77-acc2-d4a452b81996" containerName="revoke-keys"
Sep 12 02:54:59.956541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.956530    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb3194f-3ca7-4c77-acc2-d4a452b81996" containerName="revoke-keys"
Sep 12 02:54:59.959967 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.959952    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:54:59.962525 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.962504    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:54:59.962663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.962542    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:54:59.968065 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:54:59.967714    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"]
Sep 12 02:55:00.042340 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.042303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf10987-7deb-4f5e-a987-8b03ddce1c75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4b3be7-ktddc\" (UID: \"eaf10987-7deb-4f5e-a987-8b03ddce1c75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:55:00.143328 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.143297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf10987-7deb-4f5e-a987-8b03ddce1c75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4b3be7-ktddc\" (UID: \"eaf10987-7deb-4f5e-a987-8b03ddce1c75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:55:00.143972 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.143951    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf10987-7deb-4f5e-a987-8b03ddce1c75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-4b3be7-ktddc\" (UID: \"eaf10987-7deb-4f5e-a987-8b03ddce1c75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:55:00.272081 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.272008    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:55:00.545162 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.545129    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"]
Sep 12 02:55:00.545763 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:55:00.545735    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf10987_7deb_4f5e_a987_8b03ddce1c75.slice/crio-cf13dd6cd2fea1262e0815eb3111355ae9db140b2c6f093a0b21042064757df7 WatchSource:0}: Error finding container cf13dd6cd2fea1262e0815eb3111355ae9db140b2c6f093a0b21042064757df7: Status 404 returned error can't find the container with id cf13dd6cd2fea1262e0815eb3111355ae9db140b2c6f093a0b21042064757df7
Sep 12 02:55:00.928204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.928173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc" event={"ID":"eaf10987-7deb-4f5e-a987-8b03ddce1c75","Type":"ContainerStarted","Data":"c41ee5acec405a1bb51c79b308e95bd163d0df2a63a0e908990b3cff470e7d28"}
Sep 12 02:55:00.928366 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.928233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc" event={"ID":"eaf10987-7deb-4f5e-a987-8b03ddce1c75","Type":"ContainerStarted","Data":"cf13dd6cd2fea1262e0815eb3111355ae9db140b2c6f093a0b21042064757df7"}
Sep 12 02:55:00.944470 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:00.944424    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc" podStartSLOduration=1.944396845 podStartE2EDuration="1.944396845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:55:00.942345918 +0000 UTC m=+1133.198326932" watchObservedRunningTime="2026-09-12 02:55:00.944396845 +0000 UTC m=+1133.200377861"
Sep 12 02:55:01.936076 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:01.936041    2583 generic.go:356] "Generic (PLEG): container finished" podID="eaf10987-7deb-4f5e-a987-8b03ddce1c75" containerID="c41ee5acec405a1bb51c79b308e95bd163d0df2a63a0e908990b3cff470e7d28" exitCode=0
Sep 12 02:55:01.936483 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:01.936132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc" event={"ID":"eaf10987-7deb-4f5e-a987-8b03ddce1c75","Type":"ContainerDied","Data":"c41ee5acec405a1bb51c79b308e95bd163d0df2a63a0e908990b3cff470e7d28"}
Sep 12 02:55:03.083954 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.083931    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:55:03.172539 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.172496    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf10987-7deb-4f5e-a987-8b03ddce1c75-maas-api-service-ca\") pod \"eaf10987-7deb-4f5e-a987-8b03ddce1c75\" (UID: \"eaf10987-7deb-4f5e-a987-8b03ddce1c75\") "
Sep 12 02:55:03.172836 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.172809    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaf10987-7deb-4f5e-a987-8b03ddce1c75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "eaf10987-7deb-4f5e-a987-8b03ddce1c75" (UID: "eaf10987-7deb-4f5e-a987-8b03ddce1c75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:55:03.273611 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.273533    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaf10987-7deb-4f5e-a987-8b03ddce1c75-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:03.949241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.949208    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"
Sep 12 02:55:03.949439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.949212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc" event={"ID":"eaf10987-7deb-4f5e-a987-8b03ddce1c75","Type":"ContainerDied","Data":"cf13dd6cd2fea1262e0815eb3111355ae9db140b2c6f093a0b21042064757df7"}
Sep 12 02:55:03.949439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:03.949344    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf13dd6cd2fea1262e0815eb3111355ae9db140b2c6f093a0b21042064757df7"
Sep 12 02:55:04.759580 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.759543    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"]
Sep 12 02:55:04.760057 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.759827    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln" podUID="a0f10cf6-60c6-42f1-96a9-aaf476f166f5" containerName="payload-processing" containerID="cri-o://9ab532868b69fa5f6b6fa679b8b935bccfbb7aa7293fb46eae28b54eaee5221b" gracePeriod=30
Sep 12 02:55:04.765238 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.765212    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"]
Sep 12 02:55:04.765482 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.765455    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r" podUID="3e25d626-3025-4681-a91e-4bafe7930c6c" containerName="payload-pre-processing" containerID="cri-o://63cb2f208c74d9fff60347220d6b1f68147742d318e9d1ca3f68550dccbb3d11" gracePeriod=30
Sep 12 02:55:04.920232 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.920198    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"]
Sep 12 02:55:04.923471 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.923439    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc3f9c2f-dp4h4"]
Sep 12 02:55:04.956876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.956851    2583 generic.go:356] "Generic (PLEG): container finished" podID="3e25d626-3025-4681-a91e-4bafe7930c6c" containerID="63cb2f208c74d9fff60347220d6b1f68147742d318e9d1ca3f68550dccbb3d11" exitCode=0
Sep 12 02:55:04.957007 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.956928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r" event={"ID":"3e25d626-3025-4681-a91e-4bafe7930c6c","Type":"ContainerDied","Data":"63cb2f208c74d9fff60347220d6b1f68147742d318e9d1ca3f68550dccbb3d11"}
Sep 12 02:55:04.958643 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.958616    2583 generic.go:356] "Generic (PLEG): container finished" podID="a0f10cf6-60c6-42f1-96a9-aaf476f166f5" containerID="9ab532868b69fa5f6b6fa679b8b935bccfbb7aa7293fb46eae28b54eaee5221b" exitCode=0
Sep 12 02:55:04.958745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:04.958664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln" event={"ID":"a0f10cf6-60c6-42f1-96a9-aaf476f166f5","Type":"ContainerDied","Data":"9ab532868b69fa5f6b6fa679b8b935bccfbb7aa7293fb46eae28b54eaee5221b"}
Sep 12 02:55:05.052936 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.052905    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"]
Sep 12 02:55:05.053136 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.053114    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" containerID="cri-o://32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62" gracePeriod=30
Sep 12 02:55:05.065445 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.065421    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:55:05.068198 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.068180    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:55:05.091716 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.091692    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-plugins-config-volume\") pod \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") "
Sep 12 02:55:05.091846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.091783    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26cwr\" (UniqueName: \"kubernetes.io/projected/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-kube-api-access-26cwr\") pod \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\" (UID: \"a0f10cf6-60c6-42f1-96a9-aaf476f166f5\") "
Sep 12 02:55:05.092098 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.092074    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9bmv\" (UniqueName: \"kubernetes.io/projected/3e25d626-3025-4681-a91e-4bafe7930c6c-kube-api-access-n9bmv\") pod \"3e25d626-3025-4681-a91e-4bafe7930c6c\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") "
Sep 12 02:55:05.092184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.092095    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0f10cf6-60c6-42f1-96a9-aaf476f166f5" (UID: "a0f10cf6-60c6-42f1-96a9-aaf476f166f5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:55:05.092184 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.092150    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e25d626-3025-4681-a91e-4bafe7930c6c-plugins-config-volume\") pod \"3e25d626-3025-4681-a91e-4bafe7930c6c\" (UID: \"3e25d626-3025-4681-a91e-4bafe7930c6c\") "
Sep 12 02:55:05.092623 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.092585    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:05.092851 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.092831    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e25d626-3025-4681-a91e-4bafe7930c6c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e25d626-3025-4681-a91e-4bafe7930c6c" (UID: "3e25d626-3025-4681-a91e-4bafe7930c6c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:55:05.094341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.094222    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-kube-api-access-26cwr" (OuterVolumeSpecName: "kube-api-access-26cwr") pod "a0f10cf6-60c6-42f1-96a9-aaf476f166f5" (UID: "a0f10cf6-60c6-42f1-96a9-aaf476f166f5"). InnerVolumeSpecName "kube-api-access-26cwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:55:05.094767 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.094743    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e25d626-3025-4681-a91e-4bafe7930c6c-kube-api-access-n9bmv" (OuterVolumeSpecName: "kube-api-access-n9bmv") pod "3e25d626-3025-4681-a91e-4bafe7930c6c" (UID: "3e25d626-3025-4681-a91e-4bafe7930c6c"). InnerVolumeSpecName "kube-api-access-n9bmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:55:05.108895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.108864    2583 patch_prober.go:28] interesting pod/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 12 02:55:05.109001 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.108915    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 02:55:05.193921 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.193880    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26cwr\" (UniqueName: \"kubernetes.io/projected/a0f10cf6-60c6-42f1-96a9-aaf476f166f5-kube-api-access-26cwr\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:05.193921 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.193915    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9bmv\" (UniqueName: \"kubernetes.io/projected/3e25d626-3025-4681-a91e-4bafe7930c6c-kube-api-access-n9bmv\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:05.193921 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.193928    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e25d626-3025-4681-a91e-4bafe7930c6c-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:05.966134 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.966108    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"
Sep 12 02:55:05.966560 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.966142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln" event={"ID":"a0f10cf6-60c6-42f1-96a9-aaf476f166f5","Type":"ContainerDied","Data":"6455b2db8742d135b4ec280c163c438a2e3ec5a3e118bcabef7ec394425bf061"}
Sep 12 02:55:05.966560 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.966197    2583 scope.go:117] "RemoveContainer" containerID="9ab532868b69fa5f6b6fa679b8b935bccfbb7aa7293fb46eae28b54eaee5221b"
Sep 12 02:55:05.967815 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.967799    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"
Sep 12 02:55:05.967902 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.967834    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r" event={"ID":"3e25d626-3025-4681-a91e-4bafe7930c6c","Type":"ContainerDied","Data":"2a5d006914e53b4278dcc61823c45f9eb04d15ee78b1813ca3ae7ad99172ca1b"}
Sep 12 02:55:05.977592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.977514    2583 scope.go:117] "RemoveContainer" containerID="63cb2f208c74d9fff60347220d6b1f68147742d318e9d1ca3f68550dccbb3d11"
Sep 12 02:55:05.992280 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.992251    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"]
Sep 12 02:55:05.995745 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:05.995726    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-bc3f9c2f-858b9466fc-5phln"]
Sep 12 02:55:06.006480 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:06.006453    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"]
Sep 12 02:55:06.008809 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:06.008790    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-bc3f9c2f-769bdcd94-rbp5r"]
Sep 12 02:55:06.161372 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:06.161344    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e25d626-3025-4681-a91e-4bafe7930c6c" path="/var/lib/kubelet/pods/3e25d626-3025-4681-a91e-4bafe7930c6c/volumes"
Sep 12 02:55:06.161705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:06.161691    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb3194f-3ca7-4c77-acc2-d4a452b81996" path="/var/lib/kubelet/pods/7cb3194f-3ca7-4c77-acc2-d4a452b81996/volumes"
Sep 12 02:55:06.162017 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:06.162006    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0f10cf6-60c6-42f1-96a9-aaf476f166f5" path="/var/lib/kubelet/pods/a0f10cf6-60c6-42f1-96a9-aaf476f166f5/volumes"
Sep 12 02:55:10.314525 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.314501    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:55:10.442670 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-envoy\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.442846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442685    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-podinfo\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.442846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442709    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-socket\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.442846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442746    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-credential-socket\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.442846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442803    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istiod-ca-cert\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.442846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442838    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zncv\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-kube-api-access-7zncv\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.443111 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442868    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-data\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.443111 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-token\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.443111 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.442977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-certs\") pod \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\" (UID: \"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2\") "
Sep 12 02:55:10.443111 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443077    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:55:10.443322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443086    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:55:10.443322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:55:10.443322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443303    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:55:10.443832 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443810    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.443940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443849    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.443940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443863    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.443940 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.443708    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:55:10.445514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.445484    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-kube-api-access-7zncv" (OuterVolumeSpecName: "kube-api-access-7zncv") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "kube-api-access-7zncv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:55:10.454018 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.453988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:55:10.454308 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.454281    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:55:10.454640 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.454611    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" (UID: "8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:55:10.545123 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.545096    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zncv\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-kube-api-access-7zncv\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.545123 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.545118    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.545123 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.545128    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.545303 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.545136    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.545303 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.545143    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.545303 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.545150    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:10.817144 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.817113    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"]
Sep 12 02:55:10.817446 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.817383    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9" podUID="5f621527-a23d-4bd1-abfe-3658115ff2ff" containerName="payload-processing" containerID="cri-o://ff0aeb55afb0c75fb676de91f3abbc015568746ae3bef30b1951f7169074f0e8" gracePeriod=30
Sep 12 02:55:10.825723 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.825690    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"]
Sep 12 02:55:10.826007 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:10.825959    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk" podUID="1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" containerName="payload-pre-processing" containerID="cri-o://097d91355445a6b61647a5e834a13ba0f66de5efca6573c3cd906a54402e4487" gracePeriod=30
Sep 12 02:55:11.004007 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.003968    2583 generic.go:356] "Generic (PLEG): container finished" podID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerID="32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62" exitCode=0
Sep 12 02:55:11.004251 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.004230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" event={"ID":"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2","Type":"ContainerDied","Data":"32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62"}
Sep 12 02:55:11.004341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.004289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z" event={"ID":"8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2","Type":"ContainerDied","Data":"f99b86156539ece3ed10c210bf01d6873f98de18105fb2587924e895b55f0041"}
Sep 12 02:55:11.004341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.004321    2583 scope.go:117] "RemoveContainer" containerID="32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62"
Sep 12 02:55:11.004479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.004346    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"
Sep 12 02:55:11.006492 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.006467    2583 generic.go:356] "Generic (PLEG): container finished" podID="5f621527-a23d-4bd1-abfe-3658115ff2ff" containerID="ff0aeb55afb0c75fb676de91f3abbc015568746ae3bef30b1951f7169074f0e8" exitCode=0
Sep 12 02:55:11.006600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.006544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9" event={"ID":"5f621527-a23d-4bd1-abfe-3658115ff2ff","Type":"ContainerDied","Data":"ff0aeb55afb0c75fb676de91f3abbc015568746ae3bef30b1951f7169074f0e8"}
Sep 12 02:55:11.008537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.008512    2583 generic.go:356] "Generic (PLEG): container finished" podID="1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" containerID="097d91355445a6b61647a5e834a13ba0f66de5efca6573c3cd906a54402e4487" exitCode=0
Sep 12 02:55:11.008616 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.008541    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk" event={"ID":"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16","Type":"ContainerDied","Data":"097d91355445a6b61647a5e834a13ba0f66de5efca6573c3cd906a54402e4487"}
Sep 12 02:55:11.014657 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.014605    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"]
Sep 12 02:55:11.017091 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.017066    2583 scope.go:117] "RemoveContainer" containerID="37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"
Sep 12 02:55:11.019301 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.019279    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-4b3be7-ktddc"]
Sep 12 02:55:11.026188 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.026162    2583 scope.go:117] "RemoveContainer" containerID="32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62"
Sep 12 02:55:11.026521 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:55:11.026485    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62\": container with ID starting with 32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62 not found: ID does not exist" containerID="32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62"
Sep 12 02:55:11.026640 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.026518    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62"} err="failed to get container status \"32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62\": rpc error: code = NotFound desc = could not find container \"32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62\": container with ID starting with 32b29b30a5fc36dde9fbc2ada7d5b63e2e6ba1d762df46496f6be671476fdd62 not found: ID does not exist"
Sep 12 02:55:11.026640 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.026542    2583 scope.go:117] "RemoveContainer" containerID="37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"
Sep 12 02:55:11.026884 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:55:11.026845    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520\": container with ID starting with 37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520 not found: ID does not exist" containerID="37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"
Sep 12 02:55:11.026969 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.026881    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520"} err="failed to get container status \"37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520\": rpc error: code = NotFound desc = could not find container \"37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520\": container with ID starting with 37b34c2246ed4d24e5c9a20e46805eedd69594466c25f4451386bdf7a3ebf520 not found: ID does not exist"
Sep 12 02:55:11.035269 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.035251    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"]
Sep 12 02:55:11.039546 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.039525    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bc3f9c2f-openshift-default-79fb7dbdd8-qp67z"]
Sep 12 02:55:11.110543 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.110522    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:55:11.112516 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.112501    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:55:11.151255 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.151228    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f621527-a23d-4bd1-abfe-3658115ff2ff-plugins-config-volume\") pod \"5f621527-a23d-4bd1-abfe-3658115ff2ff\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") "
Sep 12 02:55:11.151861 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.151836    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlnrg\" (UniqueName: \"kubernetes.io/projected/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-kube-api-access-dlnrg\") pod \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") "
Sep 12 02:55:11.151990 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.151891    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-plugins-config-volume\") pod \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\" (UID: \"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16\") "
Sep 12 02:55:11.152061 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.152007    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4lnn\" (UniqueName: \"kubernetes.io/projected/5f621527-a23d-4bd1-abfe-3658115ff2ff-kube-api-access-h4lnn\") pod \"5f621527-a23d-4bd1-abfe-3658115ff2ff\" (UID: \"5f621527-a23d-4bd1-abfe-3658115ff2ff\") "
Sep 12 02:55:11.152608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.151838    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f621527-a23d-4bd1-abfe-3658115ff2ff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f621527-a23d-4bd1-abfe-3658115ff2ff" (UID: "5f621527-a23d-4bd1-abfe-3658115ff2ff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:55:11.152751 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.152556    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" (UID: "1f7de7ce-9edd-4b29-8160-0a7b2eb7db16"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:55:11.156355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.156317    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f621527-a23d-4bd1-abfe-3658115ff2ff-kube-api-access-h4lnn" (OuterVolumeSpecName: "kube-api-access-h4lnn") pod "5f621527-a23d-4bd1-abfe-3658115ff2ff" (UID: "5f621527-a23d-4bd1-abfe-3658115ff2ff"). InnerVolumeSpecName "kube-api-access-h4lnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:55:11.158565 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.158508    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-kube-api-access-dlnrg" (OuterVolumeSpecName: "kube-api-access-dlnrg") pod "1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" (UID: "1f7de7ce-9edd-4b29-8160-0a7b2eb7db16"). InnerVolumeSpecName "kube-api-access-dlnrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:55:11.253582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.253555    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f621527-a23d-4bd1-abfe-3658115ff2ff-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:11.253582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.253577    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlnrg\" (UniqueName: \"kubernetes.io/projected/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-kube-api-access-dlnrg\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:11.253582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.253589    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:11.253786 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:11.253599    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4lnn\" (UniqueName: \"kubernetes.io/projected/5f621527-a23d-4bd1-abfe-3658115ff2ff-kube-api-access-h4lnn\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:55:12.016846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.016810    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"
Sep 12 02:55:12.017325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.016803    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9" event={"ID":"5f621527-a23d-4bd1-abfe-3658115ff2ff","Type":"ContainerDied","Data":"2f98aed95c9654eb679fe5b1623611a6fdd9da2a6ee234b45b5d7335085f368e"}
Sep 12 02:55:12.017325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.016948    2583 scope.go:117] "RemoveContainer" containerID="ff0aeb55afb0c75fb676de91f3abbc015568746ae3bef30b1951f7169074f0e8"
Sep 12 02:55:12.018396 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.018267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk" event={"ID":"1f7de7ce-9edd-4b29-8160-0a7b2eb7db16","Type":"ContainerDied","Data":"e580d8a4c055e9eb5af2f9ee60147b4c7c53ea17cbf38c96f6e1a01ad90c1494"}
Sep 12 02:55:12.018396 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.018354    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"
Sep 12 02:55:12.029098 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.029075    2583 scope.go:117] "RemoveContainer" containerID="097d91355445a6b61647a5e834a13ba0f66de5efca6573c3cd906a54402e4487"
Sep 12 02:55:12.043446 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.043381    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"]
Sep 12 02:55:12.047104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.047084    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-4b3be7-55f8475bf9-znjc9"]
Sep 12 02:55:12.056801 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.056780    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"]
Sep 12 02:55:12.060948 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.060931    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-4b3be7-9f7ff4f58-mpbtk"]
Sep 12 02:55:12.160953 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.160931    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" path="/var/lib/kubelet/pods/1f7de7ce-9edd-4b29-8160-0a7b2eb7db16/volumes"
Sep 12 02:55:12.161273 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.161261    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f621527-a23d-4bd1-abfe-3658115ff2ff" path="/var/lib/kubelet/pods/5f621527-a23d-4bd1-abfe-3658115ff2ff/volumes"
Sep 12 02:55:12.161652 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.161640    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" path="/var/lib/kubelet/pods/8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2/volumes"
Sep 12 02:55:12.162260 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:12.162246    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaf10987-7deb-4f5e-a987-8b03ddce1c75" path="/var/lib/kubelet/pods/eaf10987-7deb-4f5e-a987-8b03ddce1c75/volumes"
Sep 12 02:55:38.191105 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191034    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"]
Sep 12 02:55:38.191535 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191519    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0f10cf6-60c6-42f1-96a9-aaf476f166f5" containerName="payload-processing"
Sep 12 02:55:38.191535 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191536    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0f10cf6-60c6-42f1-96a9-aaf476f166f5" containerName="payload-processing"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191544    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191550    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191557    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaf10987-7deb-4f5e-a987-8b03ddce1c75" containerName="revoke-keys"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191563    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaf10987-7deb-4f5e-a987-8b03ddce1c75" containerName="revoke-keys"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191577    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e25d626-3025-4681-a91e-4bafe7930c6c" containerName="payload-pre-processing"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191582    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e25d626-3025-4681-a91e-4bafe7930c6c" containerName="payload-pre-processing"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191591    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f621527-a23d-4bd1-abfe-3658115ff2ff" containerName="payload-processing"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191596    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f621527-a23d-4bd1-abfe-3658115ff2ff" containerName="payload-processing"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191610    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" containerName="payload-pre-processing"
Sep 12 02:55:38.191632 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191615    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" containerName="payload-pre-processing"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191678    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f621527-a23d-4bd1-abfe-3658115ff2ff" containerName="payload-processing"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191688    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e25d626-3025-4681-a91e-4bafe7930c6c" containerName="payload-pre-processing"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191693    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0f10cf6-60c6-42f1-96a9-aaf476f166f5" containerName="payload-processing"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191700    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191705    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7de7ce-9edd-4b29-8160-0a7b2eb7db16" containerName="payload-pre-processing"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191710    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaf10987-7deb-4f5e-a987-8b03ddce1c75" containerName="revoke-keys"
Sep 12 02:55:38.191992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.191715    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy"
Sep 12 02:55:38.194696 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.194680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.197094 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.197072    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-450f2a-openshift-default-dockercfg-zcsf8\""
Sep 12 02:55:38.203933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.203913    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"]
Sep 12 02:55:38.217493 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.217464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-envoy\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.217588 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.217515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9h98\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-kube-api-access-l9h98\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.217661 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.217631    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-credential-socket\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.217716 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.217665    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7954fd-6c0b-485e-a43c-783d19a84f07-istiod-ca-cert\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.217716 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.217693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-certs\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.217891 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.217852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-data\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.218019 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.218000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-socket\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.218100 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.218045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-token\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.218100 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.218076    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-podinfo\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319044 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-data\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319198 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319051    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-socket\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319198 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319140    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-token\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319198 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-podinfo\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319362 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-envoy\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319362 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9h98\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-kube-api-access-l9h98\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319362 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-credential-socket\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319362 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7954fd-6c0b-485e-a43c-783d19a84f07-istiod-ca-cert\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319599 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-certs\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319599 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-socket\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319599 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-data\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-credential-socket\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.319758 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.319745    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-certs\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.320030 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.320006    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7954fd-6c0b-485e-a43c-783d19a84f07-istiod-ca-cert\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.321596 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.321574    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-envoy\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.321699 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.321619    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-podinfo\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.327346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.327323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-token\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.327580 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.327563    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9h98\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-kube-api-access-l9h98\") pod \"e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") " pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.507896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.507817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:38.785232 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.785201    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"]
Sep 12 02:55:38.786745 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:55:38.786721    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7954fd_6c0b_485e_a43c_783d19a84f07.slice/crio-e3150a14ac1ef61fdb5fcfdff839fdd5b2bf495f39db0e0b194924cc88ddfd87 WatchSource:0}: Error finding container e3150a14ac1ef61fdb5fcfdff839fdd5b2bf495f39db0e0b194924cc88ddfd87: Status 404 returned error can't find the container with id e3150a14ac1ef61fdb5fcfdff839fdd5b2bf495f39db0e0b194924cc88ddfd87
Sep 12 02:55:38.789079 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.789040    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:55:38.789178 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.789131    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:55:38.789250 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:38.789175    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:55:39.197973 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:39.197932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" event={"ID":"de7954fd-6c0b-485e-a43c-783d19a84f07","Type":"ContainerStarted","Data":"ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"}
Sep 12 02:55:39.198484 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:39.197992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" event={"ID":"de7954fd-6c0b-485e-a43c-783d19a84f07","Type":"ContainerStarted","Data":"e3150a14ac1ef61fdb5fcfdff839fdd5b2bf495f39db0e0b194924cc88ddfd87"}
Sep 12 02:55:39.221623 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:39.221577    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podStartSLOduration=1.22156098 podStartE2EDuration="1.22156098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:55:39.218253803 +0000 UTC m=+1171.474234817" watchObservedRunningTime="2026-09-12 02:55:39.22156098 +0000 UTC m=+1171.477541995"
Sep 12 02:55:39.508897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:39.508813    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:39.513484 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:39.513459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:40.203559 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:40.203532    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:40.204881 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:40.204861    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:55:45.025603 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.025563    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"]
Sep 12 02:55:45.026336 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.026307    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy"
Sep 12 02:55:45.026336 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.026329    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6ce3db-9cd6-4c3a-aac7-681b7e6a8ba2" containerName="istio-proxy"
Sep 12 02:55:45.029521 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.029503    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.032054 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.032035    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-450f2a\""
Sep 12 02:55:45.040083 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.040060    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"]
Sep 12 02:55:45.044620 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.044600    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"]
Sep 12 02:55:45.044729 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.044705    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.047164 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.047138    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-450f2a-dockercfg-sz4gz\""
Sep 12 02:55:45.058149 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.058125    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"]
Sep 12 02:55:45.088552 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.088522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7d74f4-5e8e-4cac-994f-82c02e773114-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.088663 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.088647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxhd4\" (UniqueName: \"kubernetes.io/projected/97267c87-7d09-42a0-ae92-58179dce76a0-kube-api-access-mxhd4\") pod \"payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") " pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.088721 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.088684    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph44l\" (UniqueName: \"kubernetes.io/projected/1f7d74f4-5e8e-4cac-994f-82c02e773114-kube-api-access-ph44l\") pod \"payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.088721 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.088712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97267c87-7d09-42a0-ae92-58179dce76a0-plugins-config-volume\") pod \"payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") " pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.189520 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.189483    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxhd4\" (UniqueName: \"kubernetes.io/projected/97267c87-7d09-42a0-ae92-58179dce76a0-kube-api-access-mxhd4\") pod \"payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") " pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.189705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.189528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph44l\" (UniqueName: \"kubernetes.io/projected/1f7d74f4-5e8e-4cac-994f-82c02e773114-kube-api-access-ph44l\") pod \"payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.189705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.189553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97267c87-7d09-42a0-ae92-58179dce76a0-plugins-config-volume\") pod \"payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") " pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.189705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.189611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7d74f4-5e8e-4cac-994f-82c02e773114-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.190306 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.190281    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97267c87-7d09-42a0-ae92-58179dce76a0-plugins-config-volume\") pod \"payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") " pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.190306 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.190296    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7d74f4-5e8e-4cac-994f-82c02e773114-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.197364 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.197344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxhd4\" (UniqueName: \"kubernetes.io/projected/97267c87-7d09-42a0-ae92-58179dce76a0-kube-api-access-mxhd4\") pod \"payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") " pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.198036 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.198019    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph44l\" (UniqueName: \"kubernetes.io/projected/1f7d74f4-5e8e-4cac-994f-82c02e773114-kube-api-access-ph44l\") pod \"payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.342591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.342562    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:45.356873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.356850    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:45.621454 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.621427    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"]
Sep 12 02:55:45.621603 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:55:45.621581    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f7d74f4_5e8e_4cac_994f_82c02e773114.slice/crio-4e5687e4ee205e14c176f1283d9b8dfeaa3f8f7cc2fe56b63da4225cd2622927 WatchSource:0}: Error finding container 4e5687e4ee205e14c176f1283d9b8dfeaa3f8f7cc2fe56b63da4225cd2622927: Status 404 returned error can't find the container with id 4e5687e4ee205e14c176f1283d9b8dfeaa3f8f7cc2fe56b63da4225cd2622927
Sep 12 02:55:45.636554 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:45.636535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"]
Sep 12 02:55:45.637899 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:55:45.637874    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97267c87_7d09_42a0_ae92_58179dce76a0.slice/crio-c1f72c7a8d9fcd6c9c7f3e8d130db9ee57b97eb3d29c5a06d9c88f6429cec95c WatchSource:0}: Error finding container c1f72c7a8d9fcd6c9c7f3e8d130db9ee57b97eb3d29c5a06d9c88f6429cec95c: Status 404 returned error can't find the container with id c1f72c7a8d9fcd6c9c7f3e8d130db9ee57b97eb3d29c5a06d9c88f6429cec95c
Sep 12 02:55:46.243325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.243292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z" event={"ID":"1f7d74f4-5e8e-4cac-994f-82c02e773114","Type":"ContainerStarted","Data":"695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54"}
Sep 12 02:55:46.243752 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.243338    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z" event={"ID":"1f7d74f4-5e8e-4cac-994f-82c02e773114","Type":"ContainerStarted","Data":"4e5687e4ee205e14c176f1283d9b8dfeaa3f8f7cc2fe56b63da4225cd2622927"}
Sep 12 02:55:46.243752 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.243482    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:55:46.245119 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.245097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk" event={"ID":"97267c87-7d09-42a0-ae92-58179dce76a0","Type":"ContainerStarted","Data":"90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947"}
Sep 12 02:55:46.245227 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.245132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk" event={"ID":"97267c87-7d09-42a0-ae92-58179dce76a0","Type":"ContainerStarted","Data":"c1f72c7a8d9fcd6c9c7f3e8d130db9ee57b97eb3d29c5a06d9c88f6429cec95c"}
Sep 12 02:55:46.245227 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.245165    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:46.262245 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.262196    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z" podStartSLOduration=1.262180202 podStartE2EDuration="1.262180202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:55:46.258885278 +0000 UTC m=+1178.514866294" watchObservedRunningTime="2026-09-12 02:55:46.262180202 +0000 UTC m=+1178.518161222"
Sep 12 02:55:46.276730 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:46.276687    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk" podStartSLOduration=1.276673355 podStartE2EDuration="1.276673355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:55:46.275314469 +0000 UTC m=+1178.531295488" watchObservedRunningTime="2026-09-12 02:55:46.276673355 +0000 UTC m=+1178.532654370"
Sep 12 02:55:57.254268 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:57.254238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:55:57.254749 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:55:57.254321    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:56:05.389846 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:05.389812    2583 generic.go:356] "Generic (PLEG): container finished" podID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerID="ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264" exitCode=0
Sep 12 02:56:05.390255 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:05.389883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" event={"ID":"de7954fd-6c0b-485e-a43c-783d19a84f07","Type":"ContainerDied","Data":"ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"}
Sep 12 02:56:05.390302 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:05.390285    2583 scope.go:117] "RemoveContainer" containerID="ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"
Sep 12 02:56:05.391459 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:05.391430    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:56:05.391545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:05.391501    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:56:05.391545 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:05.391531    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:56:06.398316 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:06.398277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" event={"ID":"de7954fd-6c0b-485e-a43c-783d19a84f07","Type":"ContainerStarted","Data":"a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603"}
Sep 12 02:56:06.508573 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:06.508537    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:56:06.510151 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:06.509795    2583 patch_prober.go:28] interesting pod/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 12 02:56:06.510151 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:06.509866    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 12 02:56:07.508640 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:07.508593    2583 patch_prober.go:28] interesting pod/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 12 02:56:07.509137 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:07.508666    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 12 02:56:08.511862 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:08.511819    2583 patch_prober.go:28] interesting pod/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 12 02:56:08.512337 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:08.511898    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 12 02:56:08.593808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:08.593780    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:56:08.594955 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:08.594932    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 02:56:08.597640 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:08.597624    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:56:08.598537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:08.598518    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 02:56:09.508772 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:09.508735    2583 patch_prober.go:28] interesting pod/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 12 02:56:09.509085 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:09.509043    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 12 02:56:10.203759 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:10.203727    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:56:10.508705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:10.508610    2583 patch_prober.go:28] interesting pod/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 12 02:56:10.508974 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:10.508946    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 12 02:56:11.508429 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:11.508372    2583 patch_prober.go:28] interesting pod/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 12 02:56:11.508830 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:11.508479    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 12 02:56:12.512602 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:12.512573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:56:12.513866 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:12.513844    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:56:41.665259 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.665226    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"]
Sep 12 02:56:41.669025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.669004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.671743 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.671717    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-662d15cb-openshift-default-dockercfg-8dx2n\""
Sep 12 02:56:41.682732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.682712    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"]
Sep 12 02:56:41.846705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-certs\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.846882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3604ab3-d616-4338-b613-acc3fdae1649-istiod-ca-cert\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.846882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846730    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-envoy\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.846882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-istio-token\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.846882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846850    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3604ab3-d616-4338-b613-acc3fdae1649-istio-podinfo\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.847104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846887    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6rqc\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-kube-api-access-j6rqc\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.847104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.846907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-credential-socket\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.847104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.847009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-socket\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.847104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.847058    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-data\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.947975 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.947890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-istio-token\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.947975 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.947930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3604ab3-d616-4338-b613-acc3fdae1649-istio-podinfo\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.947975 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.947969    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6rqc\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-kube-api-access-j6rqc\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.947988    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-credential-socket\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-socket\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948036    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-data\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948083    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-certs\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3604ab3-d616-4338-b613-acc3fdae1649-istiod-ca-cert\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948247 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-envoy\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-credential-socket\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-socket\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-data\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948701 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-certs\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.948930 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.948912    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3604ab3-d616-4338-b613-acc3fdae1649-istiod-ca-cert\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.950397 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.950371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-envoy\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.950523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.950506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3604ab3-d616-4338-b613-acc3fdae1649-istio-podinfo\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.955610 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.955584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-istio-token\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.955807 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.955787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6rqc\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-kube-api-access-j6rqc\") pod \"e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") " pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:41.979577 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:41.979556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:42.332422 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:56:42.332369    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3604ab3_d616_4338_b613_acc3fdae1649.slice/crio-68ea6157215ed813d59e8fbb7e35c46507e70b5b4ea9661e3d67a449027630ef WatchSource:0}: Error finding container 68ea6157215ed813d59e8fbb7e35c46507e70b5b4ea9661e3d67a449027630ef: Status 404 returned error can't find the container with id 68ea6157215ed813d59e8fbb7e35c46507e70b5b4ea9661e3d67a449027630ef
Sep 12 02:56:42.335112 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.335069    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:56:42.335221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.335163    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:56:42.335221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.335206    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:56:42.337638 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.337613    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"]
Sep 12 02:56:42.629179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.629090    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" event={"ID":"c3604ab3-d616-4338-b613-acc3fdae1649","Type":"ContainerStarted","Data":"6168479c4fef3dbf9278aa75182aa240f3e9897006ee06244d33c36b156fab7d"}
Sep 12 02:56:42.629179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.629156    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" event={"ID":"c3604ab3-d616-4338-b613-acc3fdae1649","Type":"ContainerStarted","Data":"68ea6157215ed813d59e8fbb7e35c46507e70b5b4ea9661e3d67a449027630ef"}
Sep 12 02:56:42.649903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.649857    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podStartSLOduration=1.6498433129999999 podStartE2EDuration="1.649843313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:56:42.647819572 +0000 UTC m=+1234.903800588" watchObservedRunningTime="2026-09-12 02:56:42.649843313 +0000 UTC m=+1234.905824328"
Sep 12 02:56:42.980042 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:42.979967    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:43.985541 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:43.985512    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:44.649873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:44.649841    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:56:44.650744 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:56:44.650719    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:12.847988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:12.847952    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3604ab3-d616-4338-b613-acc3fdae1649" containerID="6168479c4fef3dbf9278aa75182aa240f3e9897006ee06244d33c36b156fab7d" exitCode=0
Sep 12 02:57:12.848435 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:12.848023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" event={"ID":"c3604ab3-d616-4338-b613-acc3fdae1649","Type":"ContainerDied","Data":"6168479c4fef3dbf9278aa75182aa240f3e9897006ee06244d33c36b156fab7d"}
Sep 12 02:57:12.848537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:12.848522    2583 scope.go:117] "RemoveContainer" containerID="6168479c4fef3dbf9278aa75182aa240f3e9897006ee06244d33c36b156fab7d"
Sep 12 02:57:12.849816 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:12.849792    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:12.849899 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:12.849859    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:12.849899 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:12.849890    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:13.857183 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:13.857150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" event={"ID":"c3604ab3-d616-4338-b613-acc3fdae1649","Type":"ContainerStarted","Data":"51f336d6e32eaef1780f0bf06cf41a14637bbe855d62a46752f553e406311283"}
Sep 12 02:57:13.980173 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:13.980124    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:13.981331 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:13.981301    2583 patch_prober.go:28] interesting pod/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 12 02:57:13.981481 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:13.981362    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 12 02:57:14.649934 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:14.649901    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:14.980341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:14.980248    2583 patch_prober.go:28] interesting pod/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 12 02:57:14.980341 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:14.980315    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 12 02:57:15.980700 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:15.980658    2583 patch_prober.go:28] interesting pod/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 12 02:57:15.981102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:15.980717    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 12 02:57:16.980917 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:16.980874    2583 patch_prober.go:28] interesting pod/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 12 02:57:16.981319 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:16.980935    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 12 02:57:17.980952 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:17.980911    2583 patch_prober.go:28] interesting pod/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 12 02:57:17.981360 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:17.980987    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 12 02:57:18.980253 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:18.980207    2583 patch_prober.go:28] interesting pod/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 12 02:57:18.980480 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:18.980293    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 12 02:57:19.984102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:19.984068    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:19.985087 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:19.985069    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:25.233981 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.233948    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"]
Sep 12 02:57:25.236654 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.236635    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:25.239095 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.239068    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:57:25.239204 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.239186    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:57:25.245790 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.245766    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"]
Sep 12 02:57:25.308557 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.308518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n\" (UID: \"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:25.409764 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.409729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n\" (UID: \"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:25.410342 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.410322    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n\" (UID: \"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:25.549170 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.549073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:25.823079 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.823051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"]
Sep 12 02:57:25.823724 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:57:25.823696    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f5df39b_cd7c_4e1e_a9dd_0a259dae6d55.slice/crio-890c7d65d9a1ad20a0563521f05b6e14371d47ac32d878af6aa2a535a53faa6b WatchSource:0}: Error finding container 890c7d65d9a1ad20a0563521f05b6e14371d47ac32d878af6aa2a535a53faa6b: Status 404 returned error can't find the container with id 890c7d65d9a1ad20a0563521f05b6e14371d47ac32d878af6aa2a535a53faa6b
Sep 12 02:57:25.937704 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:25.937672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n" event={"ID":"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55","Type":"ContainerStarted","Data":"890c7d65d9a1ad20a0563521f05b6e14371d47ac32d878af6aa2a535a53faa6b"}
Sep 12 02:57:26.945764 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:26.945723    2583 generic.go:356] "Generic (PLEG): container finished" podID="4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55" containerID="24a545b7daae5a1ece87f6a02708919cca608f5e4b06a8376989914372b0b85a" exitCode=0
Sep 12 02:57:26.946141 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:26.945769    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n" event={"ID":"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55","Type":"ContainerDied","Data":"24a545b7daae5a1ece87f6a02708919cca608f5e4b06a8376989914372b0b85a"}
Sep 12 02:57:28.094499 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.094477    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:28.138299 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.138263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55-maas-api-service-ca\") pod \"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55\" (UID: \"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55\") "
Sep 12 02:57:28.138597 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.138577    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55" (UID: "4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:57:28.138710 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.138690    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:28.958789 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.958760    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"
Sep 12 02:57:28.958967 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.958801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n" event={"ID":"4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55","Type":"ContainerDied","Data":"890c7d65d9a1ad20a0563521f05b6e14371d47ac32d878af6aa2a535a53faa6b"}
Sep 12 02:57:28.958967 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:28.958852    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="890c7d65d9a1ad20a0563521f05b6e14371d47ac32d878af6aa2a535a53faa6b"
Sep 12 02:57:30.002818 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.002784    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"]
Sep 12 02:57:30.003260 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.003247    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55" containerName="revoke-keys"
Sep 12 02:57:30.003305 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.003261    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55" containerName="revoke-keys"
Sep 12 02:57:30.003368 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.003359    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55" containerName="revoke-keys"
Sep 12 02:57:30.005337 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.005322    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:30.007713 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.007689    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:57:30.007713 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.007689    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:57:30.015255 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.015231    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"]
Sep 12 02:57:30.059026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.058982    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c466b44-4dac-42f4-9206-5912df9d3d73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f\" (UID: \"4c466b44-4dac-42f4-9206-5912df9d3d73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:30.160714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.160687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c466b44-4dac-42f4-9206-5912df9d3d73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f\" (UID: \"4c466b44-4dac-42f4-9206-5912df9d3d73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:30.161344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.161319    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c466b44-4dac-42f4-9206-5912df9d3d73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f\" (UID: \"4c466b44-4dac-42f4-9206-5912df9d3d73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:30.318171 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.318140    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:30.592668 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.592634    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"]
Sep 12 02:57:30.592848 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:57:30.592829    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c466b44_4dac_42f4_9206_5912df9d3d73.slice/crio-dbba7e384a457085a75fbbe56d8a6dfd4725f299d1387af22ab055deafb90cf0 WatchSource:0}: Error finding container dbba7e384a457085a75fbbe56d8a6dfd4725f299d1387af22ab055deafb90cf0: Status 404 returned error can't find the container with id dbba7e384a457085a75fbbe56d8a6dfd4725f299d1387af22ab055deafb90cf0
Sep 12 02:57:30.973195 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.973160    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f" event={"ID":"4c466b44-4dac-42f4-9206-5912df9d3d73","Type":"ContainerStarted","Data":"485d3fae40f25457b8606fa6bbfd51d84ae43f0e050435ff0b1c237f519c8167"}
Sep 12 02:57:30.973322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:30.973219    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f" event={"ID":"4c466b44-4dac-42f4-9206-5912df9d3d73","Type":"ContainerStarted","Data":"dbba7e384a457085a75fbbe56d8a6dfd4725f299d1387af22ab055deafb90cf0"}
Sep 12 02:57:31.007017 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:31.006969    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f" podStartSLOduration=2.006952196 podStartE2EDuration="2.006952196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:57:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:57:31.003596183 +0000 UTC m=+1283.259577199" watchObservedRunningTime="2026-09-12 02:57:31.006952196 +0000 UTC m=+1283.262933232"
Sep 12 02:57:31.980823 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:31.980760    2583 generic.go:356] "Generic (PLEG): container finished" podID="4c466b44-4dac-42f4-9206-5912df9d3d73" containerID="485d3fae40f25457b8606fa6bbfd51d84ae43f0e050435ff0b1c237f519c8167" exitCode=0
Sep 12 02:57:31.980985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:31.980840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f" event={"ID":"4c466b44-4dac-42f4-9206-5912df9d3d73","Type":"ContainerDied","Data":"485d3fae40f25457b8606fa6bbfd51d84ae43f0e050435ff0b1c237f519c8167"}
Sep 12 02:57:33.125104 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.125081    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:33.191955 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.191925    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c466b44-4dac-42f4-9206-5912df9d3d73-maas-api-service-ca\") pod \"4c466b44-4dac-42f4-9206-5912df9d3d73\" (UID: \"4c466b44-4dac-42f4-9206-5912df9d3d73\") "
Sep 12 02:57:33.192246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.192224    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c466b44-4dac-42f4-9206-5912df9d3d73-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c466b44-4dac-42f4-9206-5912df9d3d73" (UID: "4c466b44-4dac-42f4-9206-5912df9d3d73"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:57:33.293836 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.293754    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c466b44-4dac-42f4-9206-5912df9d3d73-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:33.994591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.994551    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f" event={"ID":"4c466b44-4dac-42f4-9206-5912df9d3d73","Type":"ContainerDied","Data":"dbba7e384a457085a75fbbe56d8a6dfd4725f299d1387af22ab055deafb90cf0"}
Sep 12 02:57:33.994591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.994570    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"
Sep 12 02:57:33.994802 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:33.994607    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbba7e384a457085a75fbbe56d8a6dfd4725f299d1387af22ab055deafb90cf0"
Sep 12 02:57:36.785429 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:36.785387    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"]
Sep 12 02:57:36.789389 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:36.789358    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-662d15cb-2jd2n"]
Sep 12 02:57:38.161463 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:38.161433    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55" path="/var/lib/kubelet/pods/4f5df39b-cd7c-4e1e-a9dd-0a259dae6d55/volumes"
Sep 12 02:57:41.624394 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.624354    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"]
Sep 12 02:57:41.624979 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.624626    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk" podUID="97267c87-7d09-42a0-ae92-58179dce76a0" containerName="payload-processing" containerID="cri-o://90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947" gracePeriod=30
Sep 12 02:57:41.634132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.634108    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"]
Sep 12 02:57:41.634368 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.634338    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z" podUID="1f7d74f4-5e8e-4cac-994f-82c02e773114" containerName="payload-pre-processing" containerID="cri-o://695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54" gracePeriod=30
Sep 12 02:57:41.785281 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.785250    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"]
Sep 12 02:57:41.788903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.788870    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-450f2a-9lv8f"]
Sep 12 02:57:41.920241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.920209    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:57:41.923046 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.923028    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:57:41.984448 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.984123    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph44l\" (UniqueName: \"kubernetes.io/projected/1f7d74f4-5e8e-4cac-994f-82c02e773114-kube-api-access-ph44l\") pod \"1f7d74f4-5e8e-4cac-994f-82c02e773114\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") "
Sep 12 02:57:41.984448 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.984209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97267c87-7d09-42a0-ae92-58179dce76a0-plugins-config-volume\") pod \"97267c87-7d09-42a0-ae92-58179dce76a0\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") "
Sep 12 02:57:41.984448 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.984318    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7d74f4-5e8e-4cac-994f-82c02e773114-plugins-config-volume\") pod \"1f7d74f4-5e8e-4cac-994f-82c02e773114\" (UID: \"1f7d74f4-5e8e-4cac-994f-82c02e773114\") "
Sep 12 02:57:41.984448 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.984391    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxhd4\" (UniqueName: \"kubernetes.io/projected/97267c87-7d09-42a0-ae92-58179dce76a0-kube-api-access-mxhd4\") pod \"97267c87-7d09-42a0-ae92-58179dce76a0\" (UID: \"97267c87-7d09-42a0-ae92-58179dce76a0\") "
Sep 12 02:57:41.988534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.985546    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97267c87-7d09-42a0-ae92-58179dce76a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "97267c87-7d09-42a0-ae92-58179dce76a0" (UID: "97267c87-7d09-42a0-ae92-58179dce76a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:57:41.988534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.988072    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97267c87-7d09-42a0-ae92-58179dce76a0-kube-api-access-mxhd4" (OuterVolumeSpecName: "kube-api-access-mxhd4") pod "97267c87-7d09-42a0-ae92-58179dce76a0" (UID: "97267c87-7d09-42a0-ae92-58179dce76a0"). InnerVolumeSpecName "kube-api-access-mxhd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:57:41.988534 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.988473    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f7d74f4-5e8e-4cac-994f-82c02e773114-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f7d74f4-5e8e-4cac-994f-82c02e773114" (UID: "1f7d74f4-5e8e-4cac-994f-82c02e773114"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:57:41.991756 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:41.990557    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f7d74f4-5e8e-4cac-994f-82c02e773114-kube-api-access-ph44l" (OuterVolumeSpecName: "kube-api-access-ph44l") pod "1f7d74f4-5e8e-4cac-994f-82c02e773114" (UID: "1f7d74f4-5e8e-4cac-994f-82c02e773114"). InnerVolumeSpecName "kube-api-access-ph44l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:57:42.052192 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.052154    2583 generic.go:356] "Generic (PLEG): container finished" podID="1f7d74f4-5e8e-4cac-994f-82c02e773114" containerID="695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54" exitCode=0
Sep 12 02:57:42.052380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.052213    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"
Sep 12 02:57:42.052380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.052234    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z" event={"ID":"1f7d74f4-5e8e-4cac-994f-82c02e773114","Type":"ContainerDied","Data":"695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54"}
Sep 12 02:57:42.052380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.052322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z" event={"ID":"1f7d74f4-5e8e-4cac-994f-82c02e773114","Type":"ContainerDied","Data":"4e5687e4ee205e14c176f1283d9b8dfeaa3f8f7cc2fe56b63da4225cd2622927"}
Sep 12 02:57:42.052380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.052354    2583 scope.go:117] "RemoveContainer" containerID="695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54"
Sep 12 02:57:42.053985 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.053963    2583 generic.go:356] "Generic (PLEG): container finished" podID="97267c87-7d09-42a0-ae92-58179dce76a0" containerID="90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947" exitCode=0
Sep 12 02:57:42.054105 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.053998    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk" event={"ID":"97267c87-7d09-42a0-ae92-58179dce76a0","Type":"ContainerDied","Data":"90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947"}
Sep 12 02:57:42.054105 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.054009    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"
Sep 12 02:57:42.054105 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.054037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk" event={"ID":"97267c87-7d09-42a0-ae92-58179dce76a0","Type":"ContainerDied","Data":"c1f72c7a8d9fcd6c9c7f3e8d130db9ee57b97eb3d29c5a06d9c88f6429cec95c"}
Sep 12 02:57:42.063808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.063765    2583 scope.go:117] "RemoveContainer" containerID="695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54"
Sep 12 02:57:42.064095 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:57:42.064075    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54\": container with ID starting with 695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54 not found: ID does not exist" containerID="695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54"
Sep 12 02:57:42.064168 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.064103    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54"} err="failed to get container status \"695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54\": rpc error: code = NotFound desc = could not find container \"695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54\": container with ID starting with 695d6911648203d9b9cadb928d82b757a20751891d64959ec2cbf6841aaa2f54 not found: ID does not exist"
Sep 12 02:57:42.064168 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.064122    2583 scope.go:117] "RemoveContainer" containerID="90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947"
Sep 12 02:57:42.072542 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.072524    2583 scope.go:117] "RemoveContainer" containerID="90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947"
Sep 12 02:57:42.072777 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:57:42.072759    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947\": container with ID starting with 90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947 not found: ID does not exist" containerID="90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947"
Sep 12 02:57:42.072822 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.072784    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947"} err="failed to get container status \"90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947\": rpc error: code = NotFound desc = could not find container \"90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947\": container with ID starting with 90037c33c1c39b565efecc7f71e3631505c85dbfa780b1f835b690c6664dd947 not found: ID does not exist"
Sep 12 02:57:42.076969 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.076949    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"]
Sep 12 02:57:42.079660 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.079640    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-450f2a-7dd8dbb6bb-c6t2z"]
Sep 12 02:57:42.086136 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.086108    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f7d74f4-5e8e-4cac-994f-82c02e773114-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:42.086223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.086165    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxhd4\" (UniqueName: \"kubernetes.io/projected/97267c87-7d09-42a0-ae92-58179dce76a0-kube-api-access-mxhd4\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:42.086223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.086182    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph44l\" (UniqueName: \"kubernetes.io/projected/1f7d74f4-5e8e-4cac-994f-82c02e773114-kube-api-access-ph44l\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:42.086223 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.086196    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97267c87-7d09-42a0-ae92-58179dce76a0-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:42.088537 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.088518    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"]
Sep 12 02:57:42.093668 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.093636    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-450f2a-d5c49c577-vr2qk"]
Sep 12 02:57:42.161340 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.161260    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f7d74f4-5e8e-4cac-994f-82c02e773114" path="/var/lib/kubelet/pods/1f7d74f4-5e8e-4cac-994f-82c02e773114/volumes"
Sep 12 02:57:42.161656 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.161643    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c466b44-4dac-42f4-9206-5912df9d3d73" path="/var/lib/kubelet/pods/4c466b44-4dac-42f4-9206-5912df9d3d73/volumes"
Sep 12 02:57:42.161972 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:42.161962    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97267c87-7d09-42a0-ae92-58179dce76a0" path="/var/lib/kubelet/pods/97267c87-7d09-42a0-ae92-58179dce76a0/volumes"
Sep 12 02:57:43.874771 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:43.874736    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"]
Sep 12 02:57:43.875222 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:43.875030    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy" containerID="cri-o://51f336d6e32eaef1780f0bf06cf41a14637bbe855d62a46752f553e406311283" gracePeriod=30
Sep 12 02:57:48.150211 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.150177    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"]
Sep 12 02:57:48.150666 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.150444    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy" containerID="cri-o://a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603" gracePeriod=30
Sep 12 02:57:48.937556 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.937525    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"]
Sep 12 02:57:48.938102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938079    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f7d74f4-5e8e-4cac-994f-82c02e773114" containerName="payload-pre-processing"
Sep 12 02:57:48.938233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938161    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f7d74f4-5e8e-4cac-994f-82c02e773114" containerName="payload-pre-processing"
Sep 12 02:57:48.938233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938184    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97267c87-7d09-42a0-ae92-58179dce76a0" containerName="payload-processing"
Sep 12 02:57:48.938233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938192    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="97267c87-7d09-42a0-ae92-58179dce76a0" containerName="payload-processing"
Sep 12 02:57:48.938233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938202    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c466b44-4dac-42f4-9206-5912df9d3d73" containerName="revoke-keys"
Sep 12 02:57:48.938233 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938211    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c466b44-4dac-42f4-9206-5912df9d3d73" containerName="revoke-keys"
Sep 12 02:57:48.938507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938339    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="97267c87-7d09-42a0-ae92-58179dce76a0" containerName="payload-processing"
Sep 12 02:57:48.938507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938357    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f7d74f4-5e8e-4cac-994f-82c02e773114" containerName="payload-pre-processing"
Sep 12 02:57:48.938507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.938368    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c466b44-4dac-42f4-9206-5912df9d3d73" containerName="revoke-keys"
Sep 12 02:57:48.941700 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.941678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:48.944315 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.944297    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-697fd4-openshift-default-dockercfg-phmq8\""
Sep 12 02:57:48.954372 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:48.954351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"]
Sep 12 02:57:49.057365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.057025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-socket\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.057365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.057078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-credential-socket\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.057365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.057107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istiod-ca-cert\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.057365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.057135    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h2s4\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-kube-api-access-6h2s4\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.057365 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.057180    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-certs\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.060539 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.060508    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-token\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.060709 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.060694    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-data\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.060863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.060848    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-envoy\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.061032 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.061017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-podinfo\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.109079 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.109045    2583 generic.go:356] "Generic (PLEG): container finished" podID="c3604ab3-d616-4338-b613-acc3fdae1649" containerID="51f336d6e32eaef1780f0bf06cf41a14637bbe855d62a46752f553e406311283" exitCode=0
Sep 12 02:57:49.109219 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.109113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" event={"ID":"c3604ab3-d616-4338-b613-acc3fdae1649","Type":"ContainerDied","Data":"51f336d6e32eaef1780f0bf06cf41a14637bbe855d62a46752f553e406311283"}
Sep 12 02:57:49.109219 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.109171    2583 scope.go:117] "RemoveContainer" containerID="6168479c4fef3dbf9278aa75182aa240f3e9897006ee06244d33c36b156fab7d"
Sep 12 02:57:49.144523 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.144469    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:49.161746 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.161722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-socket\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-credential-socket\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istiod-ca-cert\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h2s4\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-kube-api-access-6h2s4\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-certs\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162201    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-socket\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-token\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162382    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-credential-socket\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-data\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-envoy\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-podinfo\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.162678 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162664    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-certs\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.163241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.162863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-data\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.163241 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.163009    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istiod-ca-cert\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.165375 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.165328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-envoy\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.165605 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.165572    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-podinfo\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.170790 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.170769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-token\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.170898 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.170884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h2s4\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-kube-api-access-6h2s4\") pod \"e2e-noten-697fd4-openshift-default-7b499d869b-24pbl\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") " pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.256246 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.256224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:49.263286 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-socket\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263379 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263307    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-envoy\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263379 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263335    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3604ab3-d616-4338-b613-acc3fdae1649-istiod-ca-cert\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263379 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263363    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6rqc\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-kube-api-access-j6rqc\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263567 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263398    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-istio-token\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263567 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263464    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-certs\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263567 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-data\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263571    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:49.263727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263579    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3604ab3-d616-4338-b613-acc3fdae1649-istio-podinfo\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263727 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263663    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-credential-socket\") pod \"c3604ab3-d616-4338-b613-acc3fdae1649\" (UID: \"c3604ab3-d616-4338-b613-acc3fdae1649\") "
Sep 12 02:57:49.263903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263762    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3604ab3-d616-4338-b613-acc3fdae1649-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:57:49.263903 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.263867    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:49.264424 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.264030    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:49.264424 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.264110    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3604ab3-d616-4338-b613-acc3fdae1649-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.264424 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.264130    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.264424 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.264143    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.264424 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.264163    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.264743 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.264400    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:49.265754 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.265732    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3604ab3-d616-4338-b613-acc3fdae1649-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:57:49.265875 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.265814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:57:49.266103 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.266083    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:49.266103 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.266091    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-kube-api-access-j6rqc" (OuterVolumeSpecName: "kube-api-access-j6rqc") pod "c3604ab3-d616-4338-b613-acc3fdae1649" (UID: "c3604ab3-d616-4338-b613-acc3fdae1649"). InnerVolumeSpecName "kube-api-access-j6rqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:57:49.365026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.364995    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3604ab3-d616-4338-b613-acc3fdae1649-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.365026 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.365023    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.365189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.365034    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3604ab3-d616-4338-b613-acc3fdae1649-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.365189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.365042    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6rqc\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-kube-api-access-j6rqc\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.365189 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.365052    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3604ab3-d616-4338-b613-acc3fdae1649-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:49.532956 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.532929    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"]
Sep 12 02:57:49.533944 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:57:49.533916    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082e75f0_e7e2_45bf_9dc6_130ac47d4ffe.slice/crio-fa24a41c4c78d367c7cc67d988e3b0ab92ebd498f6c172a4df8d7404644faefd WatchSource:0}: Error finding container fa24a41c4c78d367c7cc67d988e3b0ab92ebd498f6c172a4df8d7404644faefd: Status 404 returned error can't find the container with id fa24a41c4c78d367c7cc67d988e3b0ab92ebd498f6c172a4df8d7404644faefd
Sep 12 02:57:49.536277 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.536245    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:49.536350 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.536310    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:49.536350 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:49.536343    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:50.116899 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.116872    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"
Sep 12 02:57:50.117078 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.116924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm" event={"ID":"c3604ab3-d616-4338-b613-acc3fdae1649","Type":"ContainerDied","Data":"68ea6157215ed813d59e8fbb7e35c46507e70b5b4ea9661e3d67a449027630ef"}
Sep 12 02:57:50.117078 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.116996    2583 scope.go:117] "RemoveContainer" containerID="51f336d6e32eaef1780f0bf06cf41a14637bbe855d62a46752f553e406311283"
Sep 12 02:57:50.118882 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.118853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" event={"ID":"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe","Type":"ContainerStarted","Data":"ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1"}
Sep 12 02:57:50.118983 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.118905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" event={"ID":"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe","Type":"ContainerStarted","Data":"fa24a41c4c78d367c7cc67d988e3b0ab92ebd498f6c172a4df8d7404644faefd"}
Sep 12 02:57:50.141176 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.141135    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" podStartSLOduration=2.14112135 podStartE2EDuration="2.14112135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:57:50.138970875 +0000 UTC m=+1302.394951891" watchObservedRunningTime="2026-09-12 02:57:50.14112135 +0000 UTC m=+1302.397102370"
Sep 12 02:57:50.152833 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.152775    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"]
Sep 12 02:57:50.161609 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.161588    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-662d15cb-openshift-default-5b55c4c4d-5c5fm"]
Sep 12 02:57:50.256649 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.256613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:50.262334 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:50.262310    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:51.127860 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:51.127828    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:51.128808 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:51.128783    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:57:52.161565 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:52.161534    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" path="/var/lib/kubelet/pods/c3604ab3-d616-4338-b613-acc3fdae1649/volumes"
Sep 12 02:57:53.405921 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.405898    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:57:53.503200 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-podinfo\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503200 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503174    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7954fd-6c0b-485e-a43c-783d19a84f07-istiod-ca-cert\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503200 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503193    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-data\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503503 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503212    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9h98\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-kube-api-access-l9h98\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503503 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503342    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-certs\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503503 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503388    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-token\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503512    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-data" (OuterVolumeSpecName: "istio-data") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:53.503658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503539    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-envoy\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503658 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503570    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-socket\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.503837 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503615    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:53.503896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503655    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de7954fd-6c0b-485e-a43c-783d19a84f07-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:57:53.503896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503788    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:53.503988 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.503905    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-credential-socket\") pod \"de7954fd-6c0b-485e-a43c-783d19a84f07\" (UID: \"de7954fd-6c0b-485e-a43c-783d19a84f07\") "
Sep 12 02:57:53.504159 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.504138    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:53.504355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.504336    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.504396 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.504364    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.504396 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.504379    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/de7954fd-6c0b-485e-a43c-783d19a84f07-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.504488 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.504393    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.504488 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.504426    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.505470 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.505443    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-kube-api-access-l9h98" (OuterVolumeSpecName: "kube-api-access-l9h98") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "kube-api-access-l9h98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:57:53.505575 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.505521    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:57:53.505770 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.505748    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:57:53.505863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.505754    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-token" (OuterVolumeSpecName: "istio-token") pod "de7954fd-6c0b-485e-a43c-783d19a84f07" (UID: "de7954fd-6c0b-485e-a43c-783d19a84f07"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:57:53.605162 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.605137    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9h98\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-kube-api-access-l9h98\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.605162 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.605161    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.605311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.605170    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:53.605311 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:53.605177    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/de7954fd-6c0b-485e-a43c-783d19a84f07-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:57:54.148718 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.148686    2583 generic.go:356] "Generic (PLEG): container finished" podID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerID="a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603" exitCode=0
Sep 12 02:57:54.148895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.148734    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"
Sep 12 02:57:54.148895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.148770    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" event={"ID":"de7954fd-6c0b-485e-a43c-783d19a84f07","Type":"ContainerDied","Data":"a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603"}
Sep 12 02:57:54.148895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.148820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv" event={"ID":"de7954fd-6c0b-485e-a43c-783d19a84f07","Type":"ContainerDied","Data":"e3150a14ac1ef61fdb5fcfdff839fdd5b2bf495f39db0e0b194924cc88ddfd87"}
Sep 12 02:57:54.148895 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.148843    2583 scope.go:117] "RemoveContainer" containerID="a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603"
Sep 12 02:57:54.159440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.159424    2583 scope.go:117] "RemoveContainer" containerID="ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"
Sep 12 02:57:54.167877 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.167852    2583 scope.go:117] "RemoveContainer" containerID="a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603"
Sep 12 02:57:54.168246 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:57:54.168219    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603\": container with ID starting with a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603 not found: ID does not exist" containerID="a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603"
Sep 12 02:57:54.168326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.168258    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603"} err="failed to get container status \"a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603\": rpc error: code = NotFound desc = could not find container \"a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603\": container with ID starting with a75492193a3c4c666036d978b1682e02ed23220972e68a9df613210609d8d603 not found: ID does not exist"
Sep 12 02:57:54.168326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.168282    2583 scope.go:117] "RemoveContainer" containerID="ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"
Sep 12 02:57:54.168667 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:57:54.168598    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264\": container with ID starting with ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264 not found: ID does not exist" containerID="ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"
Sep 12 02:57:54.168667 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.168632    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264"} err="failed to get container status \"ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264\": rpc error: code = NotFound desc = could not find container \"ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264\": container with ID starting with ce5d21aaa43c0bfef32745d9c5de52a5ebc8a3003083765c4e5c4f379f88d264 not found: ID does not exist"
Sep 12 02:57:54.171280 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.171261    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"]
Sep 12 02:57:54.177393 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:54.177374    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-450f2a-openshift-default-6c4b58449b-l85xv"]
Sep 12 02:57:56.168810 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:56.168778    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" path="/var/lib/kubelet/pods/de7954fd-6c0b-485e-a43c-783d19a84f07/volumes"
Sep 12 02:57:57.390266 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390236    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"]
Sep 12 02:57:57.390897 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390876    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390899    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390918    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390925    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390965    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390973    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390983    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy"
Sep 12 02:57:57.390992 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.390991    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy"
Sep 12 02:57:57.391326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.391102    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy"
Sep 12 02:57:57.391326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.391118    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy"
Sep 12 02:57:57.391326 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.391126    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3604ab3-d616-4338-b613-acc3fdae1649" containerName="istio-proxy"
Sep 12 02:57:57.395711 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.395690    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.398179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.398160    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-933bba-openshift-default-dockercfg-h52gk\""
Sep 12 02:57:57.404421 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.404094    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"]
Sep 12 02:57:57.442313 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-socket\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442322    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-envoy\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442342    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-token\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442428    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-certs\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-credential-socket\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442479 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-podinfo\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istiod-ca-cert\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-data\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.442762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.442745    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kk8d\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-kube-api-access-2kk8d\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.543876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.543837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-certs\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.543876 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.543879    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-credential-socket\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.543901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-podinfo\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.543956    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istiod-ca-cert\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-data\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544041    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kk8d\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-kube-api-access-2kk8d\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-socket\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-envoy\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544132 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-token\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544519 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544282    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-certs\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544625 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-data\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-socket\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544762 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544659    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-credential-socket\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.544857 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.544814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istiod-ca-cert\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.546336 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.546307    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-envoy\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.546705 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.546644    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-podinfo\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.555355 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.555337    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-token\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.555712 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.555692    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kk8d\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-kube-api-access-2kk8d\") pod \"e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") " pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:57.709343 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:57.709263    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:58.009459 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.009430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"]
Sep 12 02:57:58.010692 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:57:58.010667    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9fd59fe_6e89_41cd_98a2_43fa1aadd48d.slice/crio-4dd99f551e646ed161bedc7691317423334636aea44992e2dce19e3ee9c1a84e WatchSource:0}: Error finding container 4dd99f551e646ed161bedc7691317423334636aea44992e2dce19e3ee9c1a84e: Status 404 returned error can't find the container with id 4dd99f551e646ed161bedc7691317423334636aea44992e2dce19e3ee9c1a84e
Sep 12 02:57:58.013275 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.013247    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:58.013338 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.013308    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:58.013373 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.013336    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:57:58.184175 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.184137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" event={"ID":"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d","Type":"ContainerStarted","Data":"1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"}
Sep 12 02:57:58.184367 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.184188    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" event={"ID":"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d","Type":"ContainerStarted","Data":"4dd99f551e646ed161bedc7691317423334636aea44992e2dce19e3ee9c1a84e"}
Sep 12 02:57:58.202918 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.202862    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podStartSLOduration=1.202842748 podStartE2EDuration="1.202842748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:57:58.201318999 +0000 UTC m=+1310.457300015" watchObservedRunningTime="2026-09-12 02:57:58.202842748 +0000 UTC m=+1310.458823764"
Sep 12 02:57:58.709629 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:58.709598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:57:59.715229 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:57:59.715197    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:00.197005 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:00.196967    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:00.198000 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:00.197974    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:03.667462 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.667428    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"]
Sep 12 02:58:03.667953 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.667938    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="de7954fd-6c0b-485e-a43c-783d19a84f07" containerName="istio-proxy"
Sep 12 02:58:03.671577 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.671556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.674135 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.674112    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-933bba\""
Sep 12 02:58:03.680190 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.680165    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"]
Sep 12 02:58:03.708194 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.708169    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jk4r\" (UniqueName: \"kubernetes.io/projected/fc4a0fcc-f2b4-4132-9390-908d257861e7-kube-api-access-2jk4r\") pod \"payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.708310 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.708238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4a0fcc-f2b4-4132-9390-908d257861e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.712557 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.712538    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"]
Sep 12 02:58:03.716025 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.716011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.718971 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.718954    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-933bba-dockercfg-gxntx\""
Sep 12 02:58:03.728584 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.728564    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"]
Sep 12 02:58:03.809038 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.808999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jk4r\" (UniqueName: \"kubernetes.io/projected/fc4a0fcc-f2b4-4132-9390-908d257861e7-kube-api-access-2jk4r\") pod \"payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.809221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.809108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4a0fcc-f2b4-4132-9390-908d257861e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.809221 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.809162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf5zm\" (UniqueName: \"kubernetes.io/projected/d87d8b86-0223-4099-b757-5f7443d7573b-kube-api-access-qf5zm\") pod \"payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.809439 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.809265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87d8b86-0223-4099-b757-5f7443d7573b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.810230 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.810199    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4a0fcc-f2b4-4132-9390-908d257861e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.819912 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.819880    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jk4r\" (UniqueName: \"kubernetes.io/projected/fc4a0fcc-f2b4-4132-9390-908d257861e7-kube-api-access-2jk4r\") pod \"payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:03.910896 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.910857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf5zm\" (UniqueName: \"kubernetes.io/projected/d87d8b86-0223-4099-b757-5f7443d7573b-kube-api-access-qf5zm\") pod \"payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.911072 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.910960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87d8b86-0223-4099-b757-5f7443d7573b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.911635 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.911617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87d8b86-0223-4099-b757-5f7443d7573b-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.918685 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.918621    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf5zm\" (UniqueName: \"kubernetes.io/projected/d87d8b86-0223-4099-b757-5f7443d7573b-kube-api-access-qf5zm\") pod \"payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:03.983641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:03.983612    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:04.025869 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:04.025836    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:04.260863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:04.260837    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"]
Sep 12 02:58:04.261643 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:58:04.261616    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4a0fcc_f2b4_4132_9390_908d257861e7.slice/crio-56e2d7466f52291c8ec6b04a8169027709cc367511dbff885a610c26f4050eb1 WatchSource:0}: Error finding container 56e2d7466f52291c8ec6b04a8169027709cc367511dbff885a610c26f4050eb1: Status 404 returned error can't find the container with id 56e2d7466f52291c8ec6b04a8169027709cc367511dbff885a610c26f4050eb1
Sep 12 02:58:04.313164 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:04.313141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"]
Sep 12 02:58:04.313461 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:58:04.313439    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87d8b86_0223_4099_b757_5f7443d7573b.slice/crio-38aa29d13f4f7933641cca10c01b7e2a61dc4f0c886e6eb1722af85e164724a4 WatchSource:0}: Error finding container 38aa29d13f4f7933641cca10c01b7e2a61dc4f0c886e6eb1722af85e164724a4: Status 404 returned error can't find the container with id 38aa29d13f4f7933641cca10c01b7e2a61dc4f0c886e6eb1722af85e164724a4
Sep 12 02:58:05.235089 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.235056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8" event={"ID":"d87d8b86-0223-4099-b757-5f7443d7573b","Type":"ContainerStarted","Data":"13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a"}
Sep 12 02:58:05.235530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.235108    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8" event={"ID":"d87d8b86-0223-4099-b757-5f7443d7573b","Type":"ContainerStarted","Data":"38aa29d13f4f7933641cca10c01b7e2a61dc4f0c886e6eb1722af85e164724a4"}
Sep 12 02:58:05.235530 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.235235    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:05.236807 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.236785    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s" event={"ID":"fc4a0fcc-f2b4-4132-9390-908d257861e7","Type":"ContainerStarted","Data":"97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b"}
Sep 12 02:58:05.236933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.236821    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s" event={"ID":"fc4a0fcc-f2b4-4132-9390-908d257861e7","Type":"ContainerStarted","Data":"56e2d7466f52291c8ec6b04a8169027709cc367511dbff885a610c26f4050eb1"}
Sep 12 02:58:05.236933 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.236865    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:05.252465 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.252427    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8" podStartSLOduration=2.2524002149999998 podStartE2EDuration="2.252400215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:58:05.250286463 +0000 UTC m=+1317.506267479" watchObservedRunningTime="2026-09-12 02:58:05.252400215 +0000 UTC m=+1317.508381231"
Sep 12 02:58:05.267684 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:05.267643    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s" podStartSLOduration=2.267631455 podStartE2EDuration="2.267631455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:58:05.265292 +0000 UTC m=+1317.521273016" watchObservedRunningTime="2026-09-12 02:58:05.267631455 +0000 UTC m=+1317.523612469"
Sep 12 02:58:16.245216 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:16.245181    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 02:58:16.245726 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:16.245353    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 02:58:26.376797 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:26.376759    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerID="1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049" exitCode=0
Sep 12 02:58:26.377209 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:26.376834    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" event={"ID":"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d","Type":"ContainerDied","Data":"1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"}
Sep 12 02:58:26.377322 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:26.377308    2583 scope.go:117] "RemoveContainer" containerID="1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"
Sep 12 02:58:26.378491 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:26.378468    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:58:26.378566 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:26.378531    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:58:26.378566 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:26.378563    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:58:27.385583 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:27.385545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" event={"ID":"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d","Type":"ContainerStarted","Data":"d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11"}
Sep 12 02:58:27.711304 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:27.710330    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:27.711579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:27.711547    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 12 02:58:27.711665 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:27.711609    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 12 02:58:28.710130 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:28.710092    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 12 02:58:28.710774 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:28.710740    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 12 02:58:29.710256 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:29.710213    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 12 02:58:29.710756 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:29.710277    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 12 02:58:30.197599 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:30.197568    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:30.710119 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:30.710073    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 12 02:58:30.710328 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:30.710142    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 12 02:58:31.710288 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:31.710250    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 12 02:58:31.710599 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:31.710569    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 12 02:58:32.709714 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:32.709667    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 12 02:58:32.709918 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:32.709739    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 12 02:58:33.714157 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:33.714123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:33.714982 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:33.714960    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 02:58:38.623344 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.623310    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"]
Sep 12 02:58:38.626075 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.626059    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.628303 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.628279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-d2effd-dockercfg-lbt5l\""
Sep 12 02:58:38.628440 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.628309    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-d2effd\""
Sep 12 02:58:38.637383 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.637356    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"]
Sep 12 02:58:38.647575 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.647550    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"]
Sep 12 02:58:38.650868 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.650845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.664373 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.664343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2nbg\" (UniqueName: \"kubernetes.io/projected/6a29f3dd-04dc-4363-9628-c20288cdb4c8-kube-api-access-x2nbg\") pod \"payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.664619 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.664597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrtq\" (UniqueName: \"kubernetes.io/projected/d4ada027-f3f5-499d-ae3c-144cd9bec909-kube-api-access-nkrtq\") pod \"payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.664826 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.664808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada027-f3f5-499d-ae3c-144cd9bec909-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.664974 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.664958    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a29f3dd-04dc-4363-9628-c20288cdb4c8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.680662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.680631    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"]
Sep 12 02:58:38.773143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.773089    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrtq\" (UniqueName: \"kubernetes.io/projected/d4ada027-f3f5-499d-ae3c-144cd9bec909-kube-api-access-nkrtq\") pod \"payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.773492 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.773464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada027-f3f5-499d-ae3c-144cd9bec909-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.773692 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.773668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a29f3dd-04dc-4363-9628-c20288cdb4c8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.773925 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.773903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2nbg\" (UniqueName: \"kubernetes.io/projected/6a29f3dd-04dc-4363-9628-c20288cdb4c8-kube-api-access-x2nbg\") pod \"payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.775591 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.775568    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada027-f3f5-499d-ae3c-144cd9bec909-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.776575 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.776553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a29f3dd-04dc-4363-9628-c20288cdb4c8-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.792358 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.792316    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2nbg\" (UniqueName: \"kubernetes.io/projected/6a29f3dd-04dc-4363-9628-c20288cdb4c8-kube-api-access-x2nbg\") pod \"payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:38.794912 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.794882    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrtq\" (UniqueName: \"kubernetes.io/projected/d4ada027-f3f5-499d-ae3c-144cd9bec909-kube-api-access-nkrtq\") pod \"payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.938942 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.938867    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:38.983432 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:38.982559    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:39.250163 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.250131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"]
Sep 12 02:58:39.253372 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:58:39.253349    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ada027_f3f5_499d_ae3c_144cd9bec909.slice/crio-c59ae3b1f5e5ae90b129d6c0ec06bd908ad4c306a970abdb882a70b8a937abb6 WatchSource:0}: Error finding container c59ae3b1f5e5ae90b129d6c0ec06bd908ad4c306a970abdb882a70b8a937abb6: Status 404 returned error can't find the container with id c59ae3b1f5e5ae90b129d6c0ec06bd908ad4c306a970abdb882a70b8a937abb6
Sep 12 02:58:39.291018 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.290990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"]
Sep 12 02:58:39.292801 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:58:39.292771    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a29f3dd_04dc_4363_9628_c20288cdb4c8.slice/crio-60d6281d9cffa69b559820e59e547277d73363ca5c7d28473a2cfa772c0b3525 WatchSource:0}: Error finding container 60d6281d9cffa69b559820e59e547277d73363ca5c7d28473a2cfa772c0b3525: Status 404 returned error can't find the container with id 60d6281d9cffa69b559820e59e547277d73363ca5c7d28473a2cfa772c0b3525
Sep 12 02:58:39.486091 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.486058    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk" event={"ID":"d4ada027-f3f5-499d-ae3c-144cd9bec909","Type":"ContainerStarted","Data":"6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6"}
Sep 12 02:58:39.486091 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.486106    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk" event={"ID":"d4ada027-f3f5-499d-ae3c-144cd9bec909","Type":"ContainerStarted","Data":"c59ae3b1f5e5ae90b129d6c0ec06bd908ad4c306a970abdb882a70b8a937abb6"}
Sep 12 02:58:39.486348 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.486146    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:39.488006 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.487970    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5" event={"ID":"6a29f3dd-04dc-4363-9628-c20288cdb4c8","Type":"ContainerStarted","Data":"0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d"}
Sep 12 02:58:39.488143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.488022    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5" event={"ID":"6a29f3dd-04dc-4363-9628-c20288cdb4c8","Type":"ContainerStarted","Data":"60d6281d9cffa69b559820e59e547277d73363ca5c7d28473a2cfa772c0b3525"}
Sep 12 02:58:39.488143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.488052    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:39.501215 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.501108    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk" podStartSLOduration=1.501089974 podStartE2EDuration="1.501089974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:58:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:58:39.50004868 +0000 UTC m=+1351.756029699" watchObservedRunningTime="2026-09-12 02:58:39.501089974 +0000 UTC m=+1351.757070996"
Sep 12 02:58:39.516244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:39.516197    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5" podStartSLOduration=1.516179464 podStartE2EDuration="1.516179464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:58:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:58:39.514597022 +0000 UTC m=+1351.770578038" watchObservedRunningTime="2026-09-12 02:58:39.516179464 +0000 UTC m=+1351.772160481"
Sep 12 02:58:48.050191 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:48.050157    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"]
Sep 12 02:58:48.050729 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:48.050361    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" podUID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" containerName="istio-proxy" containerID="cri-o://ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1" gracePeriod=30
Sep 12 02:58:50.502313 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:50.502282    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 02:58:50.502724 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:50.502350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 02:58:51.130172 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:51.130133    2583 patch_prober.go:28] interesting pod/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 02:58:51.130363 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:51.130192    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" podUID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 02:58:53.304641 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.304610    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:58:53.436963 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.436926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-envoy\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.436963 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.436977    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istiod-ca-cert\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.436995    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-token\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437025    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-data\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437065    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h2s4\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-kube-api-access-6h2s4\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437105    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-certs\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437205 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437163    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-socket\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437524 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437207    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-credential-socket\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437524 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437232    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-podinfo\") pod \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\" (UID: \"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe\") "
Sep 12 02:58:53.437524 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-data" (OuterVolumeSpecName: "istio-data") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:58:53.437524 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:58:53.437732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437525    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:58:53.437732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437581    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:58:53.437732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437608    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:58:53.437732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437711    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.437732 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437723    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.437900 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437735    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.437900 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437748    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.437900 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.437758    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.439245 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.439216    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-token" (OuterVolumeSpecName: "istio-token") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:58:53.439351 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.439315    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 02:58:53.439623 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.439605    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 02:58:53.439690 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.439630    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-kube-api-access-6h2s4" (OuterVolumeSpecName: "kube-api-access-6h2s4") pod "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" (UID: "082e75f0-e7e2-45bf-9dc6-130ac47d4ffe"). InnerVolumeSpecName "kube-api-access-6h2s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:58:53.538739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.538707    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.538739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.538735    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.538739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.538743    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.538931 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.538751    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h2s4\" (UniqueName: \"kubernetes.io/projected/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe-kube-api-access-6h2s4\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:58:53.584633 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.584605    2583 generic.go:356] "Generic (PLEG): container finished" podID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" containerID="ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1" exitCode=0
Sep 12 02:58:53.584739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.584647    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"
Sep 12 02:58:53.584739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.584687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" event={"ID":"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe","Type":"ContainerDied","Data":"ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1"}
Sep 12 02:58:53.584739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.584737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl" event={"ID":"082e75f0-e7e2-45bf-9dc6-130ac47d4ffe","Type":"ContainerDied","Data":"fa24a41c4c78d367c7cc67d988e3b0ab92ebd498f6c172a4df8d7404644faefd"}
Sep 12 02:58:53.584841 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.584758    2583 scope.go:117] "RemoveContainer" containerID="ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1"
Sep 12 02:58:53.595533 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.595515    2583 scope.go:117] "RemoveContainer" containerID="ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1"
Sep 12 02:58:53.595807 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:58:53.595789    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1\": container with ID starting with ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1 not found: ID does not exist" containerID="ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1"
Sep 12 02:58:53.595868 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.595816    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1"} err="failed to get container status \"ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1\": rpc error: code = NotFound desc = could not find container \"ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1\": container with ID starting with ca43a69688bb87a67710f04480dbdcd5b5320c367ce8405d814aecfe8b055ec1 not found: ID does not exist"
Sep 12 02:58:53.607873 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.607854    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"]
Sep 12 02:58:53.610702 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:53.610683    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-697fd4-openshift-default-7b499d869b-24pbl"]
Sep 12 02:58:54.162060 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:58:54.162029    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" path="/var/lib/kubelet/pods/082e75f0-e7e2-45bf-9dc6-130ac47d4ffe/volumes"
Sep 12 02:59:08.368513 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:08.368485    2583 scope.go:117] "RemoveContainer" containerID="67127b46366cae5f07c232e65420da6d68a86a1236b9a68b74878e26099671b3"
Sep 12 02:59:13.266529 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.266497    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"]
Sep 12 02:59:13.266995 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.266979    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" containerName="istio-proxy"
Sep 12 02:59:13.266995 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.266991    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" containerName="istio-proxy"
Sep 12 02:59:13.267122 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.267066    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="082e75f0-e7e2-45bf-9dc6-130ac47d4ffe" containerName="istio-proxy"
Sep 12 02:59:13.271509 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.271489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.274380 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.274358    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1c9060bc-openshift-default-dockercfg-92f59\""
Sep 12 02:59:13.277859 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.277831    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"]
Sep 12 02:59:13.330202 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istiod-ca-cert\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330334 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwwk2\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-kube-api-access-lwwk2\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330387 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-token\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330387 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-data\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-credential-socket\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-certs\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-podinfo\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330514 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330500    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-envoy\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.330642 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.330516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-socket\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.431978 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.431947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-certs\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.431978 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.431978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-podinfo\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-envoy\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-socket\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istiod-ca-cert\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwwk2\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-kube-api-access-lwwk2\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-token\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432203 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-data\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432527 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-credential-socket\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432527 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432506    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-socket\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432609 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432555    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-credential-socket\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432662 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432641    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-data\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.432894 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.432870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-certs\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.433096 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.433080    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istiod-ca-cert\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.434462 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.434436    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-envoy\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.434620 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.434603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-podinfo\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.439592 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.439572    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-token\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.439750 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.439730    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwwk2\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-kube-api-access-lwwk2\") pod \"e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") " pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.583743 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.583706    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:13.860047 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.860019    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"]
Sep 12 02:59:13.860988 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:59:13.860965    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccb7b0c_8c6b_4c0d_b605_75a6640721d2.slice/crio-05055e0135d02d6edb3e82ee7ff4c2b32c47a65e7dd14de1c9969e737cc1ed2a WatchSource:0}: Error finding container 05055e0135d02d6edb3e82ee7ff4c2b32c47a65e7dd14de1c9969e737cc1ed2a: Status 404 returned error can't find the container with id 05055e0135d02d6edb3e82ee7ff4c2b32c47a65e7dd14de1c9969e737cc1ed2a
Sep 12 02:59:13.863739 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.863700    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:59:13.863842 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.863761    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:59:13.863842 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:13.863791    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:59:14.728261 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:14.728215    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" event={"ID":"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2","Type":"ContainerStarted","Data":"bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"}
Sep 12 02:59:14.728676 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:14.728279    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" event={"ID":"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2","Type":"ContainerStarted","Data":"05055e0135d02d6edb3e82ee7ff4c2b32c47a65e7dd14de1c9969e737cc1ed2a"}
Sep 12 02:59:14.747362 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:14.747315    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podStartSLOduration=1.747300335 podStartE2EDuration="1.747300335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:59:14.744984713 +0000 UTC m=+1387.000965729" watchObservedRunningTime="2026-09-12 02:59:14.747300335 +0000 UTC m=+1387.003281349"
Sep 12 02:59:15.583829 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:15.583795    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:15.589040 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:15.589017    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:15.734187 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:15.734156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:15.735171 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:15.735154    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:21.685922 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.685892    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"]
Sep 12 02:59:21.690103 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.690070    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.692770 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.692749    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1c9060bc\""
Sep 12 02:59:21.702506 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.702485    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"]
Sep 12 02:59:21.815346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.815309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.815548 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.815395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfc9\" (UniqueName: \"kubernetes.io/projected/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-kube-api-access-8gfc9\") pod \"payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.917056 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.917024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.917222 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.917070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gfc9\" (UniqueName: \"kubernetes.io/projected/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-kube-api-access-8gfc9\") pod \"payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.917741 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.917721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.924422 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.924389    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gfc9\" (UniqueName: \"kubernetes.io/projected/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-kube-api-access-8gfc9\") pod \"payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:21.943509 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.943452    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"]
Sep 12 02:59:21.947116 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.947102    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:21.949657 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.949637    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 02:59:21.950559 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.950537    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 02:59:21.954116 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:21.954038    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"]
Sep 12 02:59:22.003297 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.003275    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:22.018828 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.018788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v\" (UID: \"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:22.120337 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.120309    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v\" (UID: \"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:22.120926 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.120908    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v\" (UID: \"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:22.261735 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.261640    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:22.275018 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.274989    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"]
Sep 12 02:59:22.276810 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:59:22.276783    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc64fd8f_4b2f_40af_b3b7_7e7518e7d456.slice/crio-7d6fc00d722002f96e80d100251144746b14f906277c36f0692a9f3dd97aaa95 WatchSource:0}: Error finding container 7d6fc00d722002f96e80d100251144746b14f906277c36f0692a9f3dd97aaa95: Status 404 returned error can't find the container with id 7d6fc00d722002f96e80d100251144746b14f906277c36f0692a9f3dd97aaa95
Sep 12 02:59:22.535177 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.535150    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"]
Sep 12 02:59:22.536870 ip-10-0-141-22 kubenswrapper[2583]: W0912 02:59:22.536847    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d2dc0f_e66f_4890_9d5f_0d59b6fb18f2.slice/crio-88c27eadb42ee3da25cdbfe9094ab2936ceee72319a3d109e437a403508d4793 WatchSource:0}: Error finding container 88c27eadb42ee3da25cdbfe9094ab2936ceee72319a3d109e437a403508d4793: Status 404 returned error can't find the container with id 88c27eadb42ee3da25cdbfe9094ab2936ceee72319a3d109e437a403508d4793
Sep 12 02:59:22.780834 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.780798    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn" event={"ID":"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456","Type":"ContainerStarted","Data":"9aeaaa8eb566c76ec4b3591a06b4b7e2742186c63f6cbabbd4de0cacb3f4f025"}
Sep 12 02:59:22.781183 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.780858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn" event={"ID":"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456","Type":"ContainerStarted","Data":"7d6fc00d722002f96e80d100251144746b14f906277c36f0692a9f3dd97aaa95"}
Sep 12 02:59:22.781183 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.780890    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:22.782143 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.782120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v" event={"ID":"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2","Type":"ContainerStarted","Data":"88c27eadb42ee3da25cdbfe9094ab2936ceee72319a3d109e437a403508d4793"}
Sep 12 02:59:22.797941 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:22.797863    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn" podStartSLOduration=1.797848073 podStartE2EDuration="1.797848073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 02:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 02:59:22.796229355 +0000 UTC m=+1395.052210372" watchObservedRunningTime="2026-09-12 02:59:22.797848073 +0000 UTC m=+1395.053829131"
Sep 12 02:59:23.789623 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:23.789587    2583 generic.go:356] "Generic (PLEG): container finished" podID="b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2" containerID="acbd9a58aec83702d9f552edfe1a08572afadfa426125fb535e1a0e7208c0135" exitCode=0
Sep 12 02:59:23.790058 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:23.789622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v" event={"ID":"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2","Type":"ContainerDied","Data":"acbd9a58aec83702d9f552edfe1a08572afadfa426125fb535e1a0e7208c0135"}
Sep 12 02:59:24.936890 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:24.936869    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:25.054023 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:25.053947    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2-maas-api-service-ca\") pod \"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2\" (UID: \"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2\") "
Sep 12 02:59:25.054346 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:25.054320    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2" (UID: "b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:59:25.054434 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:25.054420    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:59:25.804240 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:25.804211    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"
Sep 12 02:59:25.804427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:25.804250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v" event={"ID":"b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2","Type":"ContainerDied","Data":"88c27eadb42ee3da25cdbfe9094ab2936ceee72319a3d109e437a403508d4793"}
Sep 12 02:59:25.804427 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:25.804300    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88c27eadb42ee3da25cdbfe9094ab2936ceee72319a3d109e437a403508d4793"
Sep 12 02:59:32.740211 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:32.740165    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"]
Sep 12 02:59:32.741296 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:32.741258    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k" podUID="497e3018-45d8-4ae9-8548-ae34260f7541" containerName="payload-processing" containerID="cri-o://94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081" gracePeriod=30
Sep 12 02:59:32.745211 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:32.745189    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"]
Sep 12 02:59:32.745540 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:32.745512    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn" podUID="0c8928f9-1ded-484a-b0e0-135d7eb84de3" containerName="payload-pre-processing" containerID="cri-o://89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d" gracePeriod=30
Sep 12 02:59:32.925568 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:32.914610    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"]
Sep 12 02:59:32.925568 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:32.924604    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a07b10-5h77v"]
Sep 12 02:59:33.040126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.040098    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:59:33.078181 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.078155    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:59:33.143595 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.143560    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e3018-45d8-4ae9-8548-ae34260f7541-plugins-config-volume\") pod \"497e3018-45d8-4ae9-8548-ae34260f7541\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") "
Sep 12 02:59:33.168430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.160624    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjvbk\" (UniqueName: \"kubernetes.io/projected/0c8928f9-1ded-484a-b0e0-135d7eb84de3-kube-api-access-bjvbk\") pod \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") "
Sep 12 02:59:33.168430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.160715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58rst\" (UniqueName: \"kubernetes.io/projected/497e3018-45d8-4ae9-8548-ae34260f7541-kube-api-access-58rst\") pod \"497e3018-45d8-4ae9-8548-ae34260f7541\" (UID: \"497e3018-45d8-4ae9-8548-ae34260f7541\") "
Sep 12 02:59:33.168430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.160785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8928f9-1ded-484a-b0e0-135d7eb84de3-plugins-config-volume\") pod \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\" (UID: \"0c8928f9-1ded-484a-b0e0-135d7eb84de3\") "
Sep 12 02:59:33.168430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.161935    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c8928f9-1ded-484a-b0e0-135d7eb84de3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c8928f9-1ded-484a-b0e0-135d7eb84de3" (UID: "0c8928f9-1ded-484a-b0e0-135d7eb84de3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:59:33.168430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.162913    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497e3018-45d8-4ae9-8548-ae34260f7541-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "497e3018-45d8-4ae9-8548-ae34260f7541" (UID: "497e3018-45d8-4ae9-8548-ae34260f7541"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 02:59:33.168430 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.164760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497e3018-45d8-4ae9-8548-ae34260f7541-kube-api-access-58rst" (OuterVolumeSpecName: "kube-api-access-58rst") pod "497e3018-45d8-4ae9-8548-ae34260f7541" (UID: "497e3018-45d8-4ae9-8548-ae34260f7541"). InnerVolumeSpecName "kube-api-access-58rst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:59:33.171102 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.170884    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c8928f9-1ded-484a-b0e0-135d7eb84de3-kube-api-access-bjvbk" (OuterVolumeSpecName: "kube-api-access-bjvbk") pod "0c8928f9-1ded-484a-b0e0-135d7eb84de3" (UID: "0c8928f9-1ded-484a-b0e0-135d7eb84de3"). InnerVolumeSpecName "kube-api-access-bjvbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 02:59:33.262244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.262164    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e3018-45d8-4ae9-8548-ae34260f7541-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:59:33.262244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.262191    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjvbk\" (UniqueName: \"kubernetes.io/projected/0c8928f9-1ded-484a-b0e0-135d7eb84de3-kube-api-access-bjvbk\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:59:33.262244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.262201    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58rst\" (UniqueName: \"kubernetes.io/projected/497e3018-45d8-4ae9-8548-ae34260f7541-kube-api-access-58rst\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:59:33.262244 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.262210    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c8928f9-1ded-484a-b0e0-135d7eb84de3-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 02:59:33.792035 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.792009    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 02:59:33.859325 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.859291    2583 generic.go:356] "Generic (PLEG): container finished" podID="497e3018-45d8-4ae9-8548-ae34260f7541" containerID="94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081" exitCode=0
Sep 12 02:59:33.859507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.859352    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"
Sep 12 02:59:33.859507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.859376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k" event={"ID":"497e3018-45d8-4ae9-8548-ae34260f7541","Type":"ContainerDied","Data":"94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081"}
Sep 12 02:59:33.859507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.859448    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k" event={"ID":"497e3018-45d8-4ae9-8548-ae34260f7541","Type":"ContainerDied","Data":"c51fbf8c65b4e4335c69238a0f645cbab33659334fdd756a12381d5f7095dfe0"}
Sep 12 02:59:33.859507 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.859476    2583 scope.go:117] "RemoveContainer" containerID="94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081"
Sep 12 02:59:33.861062 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.861039    2583 generic.go:356] "Generic (PLEG): container finished" podID="0c8928f9-1ded-484a-b0e0-135d7eb84de3" containerID="89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d" exitCode=0
Sep 12 02:59:33.861179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.861096    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"
Sep 12 02:59:33.861179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.861109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn" event={"ID":"0c8928f9-1ded-484a-b0e0-135d7eb84de3","Type":"ContainerDied","Data":"89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d"}
Sep 12 02:59:33.861179 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.861150    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn" event={"ID":"0c8928f9-1ded-484a-b0e0-135d7eb84de3","Type":"ContainerDied","Data":"77f48af46bb4a34faaabaf23fa53a78bd4bf6449107a14c612ff79a1a398c2fe"}
Sep 12 02:59:33.871114 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.871094    2583 scope.go:117] "RemoveContainer" containerID="94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081"
Sep 12 02:59:33.871468 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:59:33.871444    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081\": container with ID starting with 94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081 not found: ID does not exist" containerID="94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081"
Sep 12 02:59:33.871552 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.871479    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081"} err="failed to get container status \"94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081\": rpc error: code = NotFound desc = could not find container \"94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081\": container with ID starting with 94abd93482de6a827f0d6ca7b2b4c661676eda5dac923a9034fe67c7ab7fc081 not found: ID does not exist"
Sep 12 02:59:33.871552 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.871500    2583 scope.go:117] "RemoveContainer" containerID="89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d"
Sep 12 02:59:33.881126 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.881108    2583 scope.go:117] "RemoveContainer" containerID="89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d"
Sep 12 02:59:33.881546 ip-10-0-141-22 kubenswrapper[2583]: E0912 02:59:33.881526    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d\": container with ID starting with 89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d not found: ID does not exist" containerID="89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d"
Sep 12 02:59:33.881608 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.881553    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d"} err="failed to get container status \"89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d\": rpc error: code = NotFound desc = could not find container \"89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d\": container with ID starting with 89aa65ea932dc4b36d16e4f8f0af1fa1e6a1b434d952f60d296062fa1882246d not found: ID does not exist"
Sep 12 02:59:33.886278 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.886257    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"]
Sep 12 02:59:33.892082 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.892050    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a07b10-74b5b9f55-5bn6k"]
Sep 12 02:59:33.929600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.928614    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"]
Sep 12 02:59:33.929600 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:33.928673    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a07b10-6b45d8b74b-4mldn"]
Sep 12 02:59:34.162167 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:34.162138    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c8928f9-1ded-484a-b0e0-135d7eb84de3" path="/var/lib/kubelet/pods/0c8928f9-1ded-484a-b0e0-135d7eb84de3/volumes"
Sep 12 02:59:34.162579 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:34.162564    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497e3018-45d8-4ae9-8548-ae34260f7541" path="/var/lib/kubelet/pods/497e3018-45d8-4ae9-8548-ae34260f7541/volumes"
Sep 12 02:59:34.162902 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:34.162889    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2" path="/var/lib/kubelet/pods/b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2/volumes"
Sep 12 02:59:39.902898 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:39.902865    2583 generic.go:356] "Generic (PLEG): container finished" podID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerID="bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68" exitCode=0
Sep 12 02:59:39.903373 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:39.902940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" event={"ID":"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2","Type":"ContainerDied","Data":"bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"}
Sep 12 02:59:39.903373 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:39.903350    2583 scope.go:117] "RemoveContainer" containerID="bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"
Sep 12 02:59:39.904687 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:39.904660    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:59:39.904755 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:39.904727    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:59:39.904791 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:39.904756    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 02:59:40.916303 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:40.916267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" event={"ID":"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2","Type":"ContainerStarted","Data":"25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c"}
Sep 12 02:59:41.584570 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:41.584536    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:41.585582 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:41.585555    2583 patch_prober.go:28] interesting pod/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 02:59:41.585695 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:41.585602    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 02:59:42.584481 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:42.584444    2583 patch_prober.go:28] interesting pod/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 02:59:42.584863 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:42.584501    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 02:59:43.584133 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:43.584100    2583 patch_prober.go:28] interesting pod/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 02:59:43.584312 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:43.584155    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 02:59:44.584324 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:44.584284    2583 patch_prober.go:28] interesting pod/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 02:59:44.584736 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:44.584378    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 02:59:45.584338 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:45.584302    2583 patch_prober.go:28] interesting pod/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 12 02:59:45.584725 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:45.584369    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 12 02:59:45.735021 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:45.734984    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:46.589030 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:46.588996    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 02:59:46.590234 ip-10-0-141-22 kubenswrapper[2583]: I0912 02:59:46.590212    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 03:00:00.138039 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138002    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"]
Sep 12 03:00:00.138690 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138668    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497e3018-45d8-4ae9-8548-ae34260f7541" containerName="payload-processing"
Sep 12 03:00:00.138690 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138689    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="497e3018-45d8-4ae9-8548-ae34260f7541" containerName="payload-processing"
Sep 12 03:00:00.138837 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138734    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2" containerName="revoke-keys"
Sep 12 03:00:00.138837 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138743    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2" containerName="revoke-keys"
Sep 12 03:00:00.138837 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138759    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c8928f9-1ded-484a-b0e0-135d7eb84de3" containerName="payload-pre-processing"
Sep 12 03:00:00.138837 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138767    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c8928f9-1ded-484a-b0e0-135d7eb84de3" containerName="payload-pre-processing"
Sep 12 03:00:00.139033 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138884    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1d2dc0f-e66f-4890-9d5f-0d59b6fb18f2" containerName="revoke-keys"
Sep 12 03:00:00.139033 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138905    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="497e3018-45d8-4ae9-8548-ae34260f7541" containerName="payload-processing"
Sep 12 03:00:00.139033 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.138916    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c8928f9-1ded-484a-b0e0-135d7eb84de3" containerName="payload-pre-processing"
Sep 12 03:00:00.143001 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.142981    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"]
Sep 12 03:00:00.143109 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.143091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"
Sep 12 03:00:00.145302 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.145271    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:00:00.146953 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.146932    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"]
Sep 12 03:00:00.147069 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.147046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"
Sep 12 03:00:00.150592 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.150571    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"]
Sep 12 03:00:00.150706 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.150654    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"
Sep 12 03:00:00.154898 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.154612    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"]
Sep 12 03:00:00.154898 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.154682    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"]
Sep 12 03:00:00.155120 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.155104    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"
Sep 12 03:00:00.162199 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.161391    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"
Sep 12 03:00:00.173434 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.170998    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"]
Sep 12 03:00:00.173434 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.171050    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"]
Sep 12 03:00:00.194316 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.194292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"]
Sep 12 03:00:00.194463 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.194332    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"]
Sep 12 03:00:00.194463 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.194437    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"
Sep 12 03:00:00.205608 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.205590    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"
Sep 12 03:00:00.215700 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.215678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"
Sep 12 03:00:00.266131 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.265968    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"
Sep 12 03:00:00.277529 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.277502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"
Sep 12 03:00:00.453599 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.453568    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"]
Sep 12 03:00:00.454497 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:00.454463    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3153ac7e_7fcc_44d2_870d_e0b5d5f43f12.slice/crio-4f8efd610f084ca086d1c6da31635059c96d84a624853c73bafbf0be4e778912 WatchSource:0}: Error finding container 4f8efd610f084ca086d1c6da31635059c96d84a624853c73bafbf0be4e778912: Status 404 returned error can't find the container with id 4f8efd610f084ca086d1c6da31635059c96d84a624853c73bafbf0be4e778912
Sep 12 03:00:00.496180 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.496155    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"]
Sep 12 03:00:00.496672 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:00.496651    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod546a055a_3681_43c9_a526_b0dcdcc5e384.slice/crio-5e6852dece3c18a3b44de9f7d3a688450ba95174da83baa90f3d66ff6d58fe91 WatchSource:0}: Error finding container 5e6852dece3c18a3b44de9f7d3a688450ba95174da83baa90f3d66ff6d58fe91: Status 404 returned error can't find the container with id 5e6852dece3c18a3b44de9f7d3a688450ba95174da83baa90f3d66ff6d58fe91
Sep 12 03:00:00.505470 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.505449    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"]
Sep 12 03:00:00.507291 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:00.507268    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa9db66_b494_4a88_99da_e48ee5f56e7e.slice/crio-3f29a8044cc8af42eb9536fe585130008bf6fdeee2806a3fe6aa0bb97291c5ce WatchSource:0}: Error finding container 3f29a8044cc8af42eb9536fe585130008bf6fdeee2806a3fe6aa0bb97291c5ce: Status 404 returned error can't find the container with id 3f29a8044cc8af42eb9536fe585130008bf6fdeee2806a3fe6aa0bb97291c5ce
Sep 12 03:00:00.561932 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.561906    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"]
Sep 12 03:00:00.563058 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:00.563019    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225e4129_25b7_48c5_8c6b_78c697b56eae.slice/crio-0165e238a045271fd343c19ff4f84ca4bbd1c604b8dd870939506eb86c396a74 WatchSource:0}: Error finding container 0165e238a045271fd343c19ff4f84ca4bbd1c604b8dd870939506eb86c396a74: Status 404 returned error can't find the container with id 0165e238a045271fd343c19ff4f84ca4bbd1c604b8dd870939506eb86c396a74
Sep 12 03:00:00.566612 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:00.566557    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ce2542_1851_43c9_828f_a77ddde4bf4e.slice/crio-15c78bc75dff84a42d39a159d45e0194ee74028e0bb4383bffb02b2293a1dc6f WatchSource:0}: Error finding container 15c78bc75dff84a42d39a159d45e0194ee74028e0bb4383bffb02b2293a1dc6f: Status 404 returned error can't find the container with id 15c78bc75dff84a42d39a159d45e0194ee74028e0bb4383bffb02b2293a1dc6f
Sep 12 03:00:00.566740 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:00.566720    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"]
Sep 12 03:00:01.056883 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.056851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6" event={"ID":"daa9db66-b494-4a88-99da-e48ee5f56e7e","Type":"ContainerStarted","Data":"5b482626cf0c6aaf020d0c86f4554d41f17946452aea6b474fd9445d83f9c53d"}
Sep 12 03:00:01.057016 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.056907    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6" event={"ID":"daa9db66-b494-4a88-99da-e48ee5f56e7e","Type":"ContainerStarted","Data":"3f29a8044cc8af42eb9536fe585130008bf6fdeee2806a3fe6aa0bb97291c5ce"}
Sep 12 03:00:01.058545 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.058517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl" event={"ID":"3153ac7e-7fcc-44d2-870d-e0b5d5f43f12","Type":"ContainerStarted","Data":"5fdd35cd3a6cf1676714b68d77a1d287dc54a42ef54ffe6f63fa071a78f9a393"}
Sep 12 03:00:01.058645 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.058558    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl" event={"ID":"3153ac7e-7fcc-44d2-870d-e0b5d5f43f12","Type":"ContainerStarted","Data":"4f8efd610f084ca086d1c6da31635059c96d84a624853c73bafbf0be4e778912"}
Sep 12 03:00:01.060064 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.060033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6" event={"ID":"225e4129-25b7-48c5-8c6b-78c697b56eae","Type":"ContainerStarted","Data":"cdd4e79d5c54b8ae3bb5ffc78f4f041cc639365b582952fb77964f683d7f9af3"}
Sep 12 03:00:01.060156 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.060089    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6" event={"ID":"225e4129-25b7-48c5-8c6b-78c697b56eae","Type":"ContainerStarted","Data":"0165e238a045271fd343c19ff4f84ca4bbd1c604b8dd870939506eb86c396a74"}
Sep 12 03:00:01.061647 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.061622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2" event={"ID":"a4ce2542-1851-43c9-828f-a77ddde4bf4e","Type":"ContainerStarted","Data":"f1d2771aaa5950fc85d4fcc4a3fd418777fee43db2b992c672e6b229cd7c47e1"}
Sep 12 03:00:01.061748 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.061672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2" event={"ID":"a4ce2542-1851-43c9-828f-a77ddde4bf4e","Type":"ContainerStarted","Data":"15c78bc75dff84a42d39a159d45e0194ee74028e0bb4383bffb02b2293a1dc6f"}
Sep 12 03:00:01.063113 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.063089    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j" event={"ID":"546a055a-3681-43c9-a526-b0dcdcc5e384","Type":"ContainerStarted","Data":"f8f77a778859798617988cb0269268fc56a51bef08a6bac4dd366b81f2394e7e"}
Sep 12 03:00:01.063216 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.063121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j" event={"ID":"546a055a-3681-43c9-a526-b0dcdcc5e384","Type":"ContainerStarted","Data":"5e6852dece3c18a3b44de9f7d3a688450ba95174da83baa90f3d66ff6d58fe91"}
Sep 12 03:00:01.070460 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.070393    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6" podStartSLOduration=1.070379902 podStartE2EDuration="1.070379902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:01.06908425 +0000 UTC m=+1433.325065265" watchObservedRunningTime="2026-09-12 03:00:01.070379902 +0000 UTC m=+1433.326360917"
Sep 12 03:00:01.082887 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.082853    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6" podStartSLOduration=1.082841137 podStartE2EDuration="1.082841137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:01.082489063 +0000 UTC m=+1433.338470090" watchObservedRunningTime="2026-09-12 03:00:01.082841137 +0000 UTC m=+1433.338822152"
Sep 12 03:00:01.096822 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.096789    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2" podStartSLOduration=1.096774407 podStartE2EDuration="1.096774407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:01.095467106 +0000 UTC m=+1433.351448136" watchObservedRunningTime="2026-09-12 03:00:01.096774407 +0000 UTC m=+1433.352755423"
Sep 12 03:00:01.111790 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.111645    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl" podStartSLOduration=1.111629315 podStartE2EDuration="1.111629315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:01.111525315 +0000 UTC m=+1433.367506331" watchObservedRunningTime="2026-09-12 03:00:01.111629315 +0000 UTC m=+1433.367610332"
Sep 12 03:00:01.125237 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:01.125195    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j" podStartSLOduration=1.125182089 podStartE2EDuration="1.125182089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:01.123972031 +0000 UTC m=+1433.379953058" watchObservedRunningTime="2026-09-12 03:00:01.125182089 +0000 UTC m=+1433.381163143"
Sep 12 03:00:02.071707 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.071673    2583 generic.go:356] "Generic (PLEG): container finished" podID="daa9db66-b494-4a88-99da-e48ee5f56e7e" containerID="5b482626cf0c6aaf020d0c86f4554d41f17946452aea6b474fd9445d83f9c53d" exitCode=0
Sep 12 03:00:02.072129 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.071732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6" event={"ID":"daa9db66-b494-4a88-99da-e48ee5f56e7e","Type":"ContainerDied","Data":"5b482626cf0c6aaf020d0c86f4554d41f17946452aea6b474fd9445d83f9c53d"}
Sep 12 03:00:02.073302 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.073280    2583 generic.go:356] "Generic (PLEG): container finished" podID="3153ac7e-7fcc-44d2-870d-e0b5d5f43f12" containerID="5fdd35cd3a6cf1676714b68d77a1d287dc54a42ef54ffe6f63fa071a78f9a393" exitCode=0
Sep 12 03:00:02.073437 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.073308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl" event={"ID":"3153ac7e-7fcc-44d2-870d-e0b5d5f43f12","Type":"ContainerDied","Data":"5fdd35cd3a6cf1676714b68d77a1d287dc54a42ef54ffe6f63fa071a78f9a393"}
Sep 12 03:00:02.074994 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.074977    2583 generic.go:356] "Generic (PLEG): container finished" podID="225e4129-25b7-48c5-8c6b-78c697b56eae" containerID="cdd4e79d5c54b8ae3bb5ffc78f4f041cc639365b582952fb77964f683d7f9af3" exitCode=0
Sep 12 03:00:02.075090 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.075056    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6" event={"ID":"225e4129-25b7-48c5-8c6b-78c697b56eae","Type":"ContainerDied","Data":"cdd4e79d5c54b8ae3bb5ffc78f4f041cc639365b582952fb77964f683d7f9af3"}
Sep 12 03:00:02.076578 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.076559    2583 generic.go:356] "Generic (PLEG): container finished" podID="a4ce2542-1851-43c9-828f-a77ddde4bf4e" containerID="f1d2771aaa5950fc85d4fcc4a3fd418777fee43db2b992c672e6b229cd7c47e1" exitCode=0
Sep 12 03:00:02.076672 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.076623    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2" event={"ID":"a4ce2542-1851-43c9-828f-a77ddde4bf4e","Type":"ContainerDied","Data":"f1d2771aaa5950fc85d4fcc4a3fd418777fee43db2b992c672e6b229cd7c47e1"}
Sep 12 03:00:02.078074 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.078053    2583 generic.go:356] "Generic (PLEG): container finished" podID="546a055a-3681-43c9-a526-b0dcdcc5e384" containerID="f8f77a778859798617988cb0269268fc56a51bef08a6bac4dd366b81f2394e7e" exitCode=0
Sep 12 03:00:02.078157 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:02.078096    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j" event={"ID":"546a055a-3681-43c9-a526-b0dcdcc5e384","Type":"ContainerDied","Data":"f8f77a778859798617988cb0269268fc56a51bef08a6bac4dd366b81f2394e7e"}
Sep 12 03:00:03.243065 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:03.243035    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"
Sep 12 03:00:03.270012 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:03.269986    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"
Sep 12 03:00:03.327577 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:03.327550    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"
Sep 12 03:00:03.331092 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:03.331051    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"
Sep 12 03:00:03.334668 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:03.334644    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"
Sep 12 03:00:04.096465 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.096433    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"
Sep 12 03:00:04.096465 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.096450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6" event={"ID":"225e4129-25b7-48c5-8c6b-78c697b56eae","Type":"ContainerDied","Data":"0165e238a045271fd343c19ff4f84ca4bbd1c604b8dd870939506eb86c396a74"}
Sep 12 03:00:04.096694 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.096502    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0165e238a045271fd343c19ff4f84ca4bbd1c604b8dd870939506eb86c396a74"
Sep 12 03:00:04.097776 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.097754    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"
Sep 12 03:00:04.097900 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.097799    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2" event={"ID":"a4ce2542-1851-43c9-828f-a77ddde4bf4e","Type":"ContainerDied","Data":"15c78bc75dff84a42d39a159d45e0194ee74028e0bb4383bffb02b2293a1dc6f"}
Sep 12 03:00:04.097900 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.097852    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15c78bc75dff84a42d39a159d45e0194ee74028e0bb4383bffb02b2293a1dc6f"
Sep 12 03:00:04.099536 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.099510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j" event={"ID":"546a055a-3681-43c9-a526-b0dcdcc5e384","Type":"ContainerDied","Data":"5e6852dece3c18a3b44de9f7d3a688450ba95174da83baa90f3d66ff6d58fe91"}
Sep 12 03:00:04.099675 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.099568    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e6852dece3c18a3b44de9f7d3a688450ba95174da83baa90f3d66ff6d58fe91"
Sep 12 03:00:04.099675 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.099524    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"
Sep 12 03:00:04.100873 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.100855    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"
Sep 12 03:00:04.100991 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.100873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6" event={"ID":"daa9db66-b494-4a88-99da-e48ee5f56e7e","Type":"ContainerDied","Data":"3f29a8044cc8af42eb9536fe585130008bf6fdeee2806a3fe6aa0bb97291c5ce"}
Sep 12 03:00:04.100991 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.100913    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f29a8044cc8af42eb9536fe585130008bf6fdeee2806a3fe6aa0bb97291c5ce"
Sep 12 03:00:04.102454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.102430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl" event={"ID":"3153ac7e-7fcc-44d2-870d-e0b5d5f43f12","Type":"ContainerDied","Data":"4f8efd610f084ca086d1c6da31635059c96d84a624853c73bafbf0be4e778912"}
Sep 12 03:00:04.102567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.102461    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"
Sep 12 03:00:04.102567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:04.102471    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f8efd610f084ca086d1c6da31635059c96d84a624853c73bafbf0be4e778912"
Sep 12 03:00:08.396707 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:08.396678    2583 scope.go:117] "RemoveContainer" containerID="319aef3153e4b1af4096773cca449f6d9dd91f3e3395ce1fc552975cde412d54"
Sep 12 03:00:08.405733 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:08.405718    2583 scope.go:117] "RemoveContainer" containerID="1ed8cd5c77ad8a7be2cfe19b96a269693917c1ca89503f132e1f7d49a415e0fd"
Sep 12 03:00:15.150158 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.150123    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"]
Sep 12 03:00:15.150617 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.150371    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" containerID="cri-o://22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533" gracePeriod=30
Sep 12 03:00:15.510359 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510284    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"]
Sep 12 03:00:15.510810 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510794    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3153ac7e-7fcc-44d2-870d-e0b5d5f43f12" containerName="cleanup"
Sep 12 03:00:15.510857 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510812    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3153ac7e-7fcc-44d2-870d-e0b5d5f43f12" containerName="cleanup"
Sep 12 03:00:15.510857 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510836    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daa9db66-b494-4a88-99da-e48ee5f56e7e" containerName="cleanup"
Sep 12 03:00:15.510857 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510841    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="daa9db66-b494-4a88-99da-e48ee5f56e7e" containerName="cleanup"
Sep 12 03:00:15.510857 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510851    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546a055a-3681-43c9-a526-b0dcdcc5e384" containerName="cleanup"
Sep 12 03:00:15.510857 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510858    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="546a055a-3681-43c9-a526-b0dcdcc5e384" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510865    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ce2542-1851-43c9-828f-a77ddde4bf4e" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510870    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ce2542-1851-43c9-828f-a77ddde4bf4e" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510879    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="225e4129-25b7-48c5-8c6b-78c697b56eae" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510884    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="225e4129-25b7-48c5-8c6b-78c697b56eae" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510953    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="546a055a-3681-43c9-a526-b0dcdcc5e384" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510964    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="daa9db66-b494-4a88-99da-e48ee5f56e7e" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510971    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="225e4129-25b7-48c5-8c6b-78c697b56eae" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510977    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ce2542-1851-43c9-828f-a77ddde4bf4e" containerName="cleanup"
Sep 12 03:00:15.511014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.510984    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3153ac7e-7fcc-44d2-870d-e0b5d5f43f12" containerName="cleanup"
Sep 12 03:00:15.514294 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.514280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:15.516553 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.516531    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:00:15.516553 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.516540    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:00:15.521688 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.521664    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"]
Sep 12 03:00:15.581049 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.581021    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c474e8-25a4-45c2-8108-2839aeea73c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f93121-vqssz\" (UID: \"69c474e8-25a4-45c2-8108-2839aeea73c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:15.682028 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.682000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c474e8-25a4-45c2-8108-2839aeea73c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f93121-vqssz\" (UID: \"69c474e8-25a4-45c2-8108-2839aeea73c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:15.682592 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.682571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c474e8-25a4-45c2-8108-2839aeea73c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-f93121-vqssz\" (UID: \"69c474e8-25a4-45c2-8108-2839aeea73c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:15.827044 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:15.827013    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:16.100553 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:16.100526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"]
Sep 12 03:00:16.102230 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:16.102203    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c474e8_25a4_45c2_8108_2839aeea73c0.slice/crio-8b062b54458af989a8ae909cb9bd91d1fc42ce17471fd1b1facb22a45b4a5867 WatchSource:0}: Error finding container 8b062b54458af989a8ae909cb9bd91d1fc42ce17471fd1b1facb22a45b4a5867: Status 404 returned error can't find the container with id 8b062b54458af989a8ae909cb9bd91d1fc42ce17471fd1b1facb22a45b4a5867
Sep 12 03:00:16.181673 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:16.181646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz" event={"ID":"69c474e8-25a4-45c2-8108-2839aeea73c0","Type":"ContainerStarted","Data":"8b062b54458af989a8ae909cb9bd91d1fc42ce17471fd1b1facb22a45b4a5867"}
Sep 12 03:00:17.189943 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:17.189862    2583 generic.go:356] "Generic (PLEG): container finished" podID="69c474e8-25a4-45c2-8108-2839aeea73c0" containerID="c88e78709f89a4b9eaae717a01792b6425aa179d0ce1e2b46c9f35f020e409d0" exitCode=0
Sep 12 03:00:17.190305 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:17.189947    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz" event={"ID":"69c474e8-25a4-45c2-8108-2839aeea73c0","Type":"ContainerDied","Data":"c88e78709f89a4b9eaae717a01792b6425aa179d0ce1e2b46c9f35f020e409d0"}
Sep 12 03:00:18.351799 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:18.351769    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:18.407497 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:18.407463    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c474e8-25a4-45c2-8108-2839aeea73c0-maas-api-service-ca\") pod \"69c474e8-25a4-45c2-8108-2839aeea73c0\" (UID: \"69c474e8-25a4-45c2-8108-2839aeea73c0\") "
Sep 12 03:00:18.407794 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:18.407770    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69c474e8-25a4-45c2-8108-2839aeea73c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "69c474e8-25a4-45c2-8108-2839aeea73c0" (UID: "69c474e8-25a4-45c2-8108-2839aeea73c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:00:18.407882 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:18.407869    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/69c474e8-25a4-45c2-8108-2839aeea73c0-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:19.204398 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:19.204367    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz" event={"ID":"69c474e8-25a4-45c2-8108-2839aeea73c0","Type":"ContainerDied","Data":"8b062b54458af989a8ae909cb9bd91d1fc42ce17471fd1b1facb22a45b4a5867"}
Sep 12 03:00:19.204603 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:19.204440    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b062b54458af989a8ae909cb9bd91d1fc42ce17471fd1b1facb22a45b4a5867"
Sep 12 03:00:19.204603 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:19.204374    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"
Sep 12 03:00:19.604091 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:19.604054    2583 patch_prober.go:28] interesting pod/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 03:00:19.604487 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:19.604107    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 03:00:20.407038 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.407014    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 03:00:20.426763 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426673    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-socket\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.426763 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426713    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-envoy\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.426763 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426736    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-credential-socket\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-certs\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426826    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-data\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426855    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-token\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426886    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-podinfo\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426920    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvpf6\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-kube-api-access-pvpf6\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1755ced-7a50-46aa-8c68-a61c96c02a12-istiod-ca-cert\") pod \"a1755ced-7a50-46aa-8c68-a61c96c02a12\" (UID: \"a1755ced-7a50-46aa-8c68-a61c96c02a12\") "
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.426982    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.427302    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1755ced-7a50-46aa-8c68-a61c96c02a12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.427622    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.427541    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1755ced-7a50-46aa-8c68-a61c96c02a12-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.427656    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.427658    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:00:20.428056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.427921    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:00:20.429883 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.429848    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:00:20.429991 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.429891    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-kube-api-access-pvpf6" (OuterVolumeSpecName: "kube-api-access-pvpf6") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "kube-api-access-pvpf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:00:20.429991 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.429910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:00:20.430430 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.430385    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1755ced-7a50-46aa-8c68-a61c96c02a12" (UID: "a1755ced-7a50-46aa-8c68-a61c96c02a12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:00:20.528601 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528565    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.528601 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528588    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.528601 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528596    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.528601 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528604    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.528848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528613    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvpf6\" (UniqueName: \"kubernetes.io/projected/a1755ced-7a50-46aa-8c68-a61c96c02a12-kube-api-access-pvpf6\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.528848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528621    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:20.528848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:20.528631    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1755ced-7a50-46aa-8c68-a61c96c02a12-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:00:21.218825 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.218785    2583 generic.go:356] "Generic (PLEG): container finished" podID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerID="22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533" exitCode=0
Sep 12 03:00:21.219243 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.218834    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"
Sep 12 03:00:21.219243 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.218870    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" event={"ID":"a1755ced-7a50-46aa-8c68-a61c96c02a12","Type":"ContainerDied","Data":"22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533"}
Sep 12 03:00:21.219243 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.218932    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7" event={"ID":"a1755ced-7a50-46aa-8c68-a61c96c02a12","Type":"ContainerDied","Data":"f0f36d590384b898289b7e4e5ca3d3574e2d774b835de30d814f672ba83298ca"}
Sep 12 03:00:21.219243 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.218965    2583 scope.go:117] "RemoveContainer" containerID="22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533"
Sep 12 03:00:21.230316 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.230297    2583 scope.go:117] "RemoveContainer" containerID="0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"
Sep 12 03:00:21.240144 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.240125    2583 scope.go:117] "RemoveContainer" containerID="22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533"
Sep 12 03:00:21.240484 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:00:21.240464    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533\": container with ID starting with 22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533 not found: ID does not exist" containerID="22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533"
Sep 12 03:00:21.240538 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.240494    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533"} err="failed to get container status \"22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533\": rpc error: code = NotFound desc = could not find container \"22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533\": container with ID starting with 22540a6b69fd9cf0dfddd9cb8514d07862d63844e4fd1cd381ccb3b6e2e30533 not found: ID does not exist"
Sep 12 03:00:21.240538 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.240513    2583 scope.go:117] "RemoveContainer" containerID="0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"
Sep 12 03:00:21.240781 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:00:21.240766    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf\": container with ID starting with 0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf not found: ID does not exist" containerID="0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"
Sep 12 03:00:21.240819 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.240787    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf"} err="failed to get container status \"0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf\": rpc error: code = NotFound desc = could not find container \"0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf\": container with ID starting with 0f6b791c2186327be14edd0ecc515246458002a5a68b49d3db886b4f906be7bf not found: ID does not exist"
Sep 12 03:00:21.241505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.241482    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"]
Sep 12 03:00:21.249438 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:21.248335    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a07b10-openshift-default-7b76894bd4-qt4m7"]
Sep 12 03:00:22.161905 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:22.161870    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" path="/var/lib/kubelet/pods/a1755ced-7a50-46aa-8c68-a61c96c02a12/volumes"
Sep 12 03:00:25.952703 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:25.952671    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"]
Sep 12 03:00:25.955723 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:25.955694    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f93121-29819700-9df8j"]
Sep 12 03:00:26.143374 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:26.143335    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"]
Sep 12 03:00:26.146204 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:26.146183    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-f93121-vqssz"]
Sep 12 03:00:26.161667 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:26.161641    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546a055a-3681-43c9-a526-b0dcdcc5e384" path="/var/lib/kubelet/pods/546a055a-3681-43c9-a526-b0dcdcc5e384/volumes"
Sep 12 03:00:26.161957 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:26.161945    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69c474e8-25a4-45c2-8108-2839aeea73c0" path="/var/lib/kubelet/pods/69c474e8-25a4-45c2-8108-2839aeea73c0/volumes"
Sep 12 03:00:33.575737 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.575706    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"]
Sep 12 03:00:33.576166 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576154    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy"
Sep 12 03:00:33.576207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576167    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy"
Sep 12 03:00:33.576207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576188    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy"
Sep 12 03:00:33.576207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576194    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy"
Sep 12 03:00:33.576207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576201    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69c474e8-25a4-45c2-8108-2839aeea73c0" containerName="revoke-keys"
Sep 12 03:00:33.576207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576206    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="69c474e8-25a4-45c2-8108-2839aeea73c0" containerName="revoke-keys"
Sep 12 03:00:33.576370 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576277    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy"
Sep 12 03:00:33.576370 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576286    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="69c474e8-25a4-45c2-8108-2839aeea73c0" containerName="revoke-keys"
Sep 12 03:00:33.576370 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.576293    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1755ced-7a50-46aa-8c68-a61c96c02a12" containerName="istio-proxy"
Sep 12 03:00:33.581083 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.581067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.584831 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.584813    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-f91169-openshift-default-dockercfg-crrqr\""
Sep 12 03:00:33.594911 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.594885    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"]
Sep 12 03:00:33.672894 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.672860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-envoy\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.672916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-data\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.672973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-token\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.673000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istiod-ca-cert\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.673026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-certs\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.673056    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-podinfo\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673267 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.673194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-socket\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673267 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.673224    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77frv\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-kube-api-access-77frv\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.673267 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.673243    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-credential-socket\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.774771 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-envoy\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.774973 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774788    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-data\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.774973 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-token\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.774973 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774848    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istiod-ca-cert\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.774973 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-certs\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.774973 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774907    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-podinfo\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775252 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.774993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-socket\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775252 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.775019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77frv\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-kube-api-access-77frv\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775252 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.775047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-credential-socket\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775252 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.775197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-data\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775481 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.775430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-credential-socket\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775625 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.775584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istiod-ca-cert\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.775976 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.775912    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-certs\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.776303 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.776282    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-socket\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.779458 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.778884    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-envoy\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.780092 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.780066    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-podinfo\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.784994 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.784929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-token\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.788073 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.788030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77frv\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-kube-api-access-77frv\") pod \"e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") " pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:33.892069 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:33.891986    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:34.168751 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.168725    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"]
Sep 12 03:00:34.169371 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:34.169342    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a15fb9_ba16_43a6_a2f1_fbc3a0d61cee.slice/crio-3837ad478bb697923dded6218a8d7107cfefdeb3cd328c9d6ef69786808fb78f WatchSource:0}: Error finding container 3837ad478bb697923dded6218a8d7107cfefdeb3cd328c9d6ef69786808fb78f: Status 404 returned error can't find the container with id 3837ad478bb697923dded6218a8d7107cfefdeb3cd328c9d6ef69786808fb78f
Sep 12 03:00:34.171826 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.171788    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:00:34.171936 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.171877    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:00:34.171936 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.171921    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:00:34.309713 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.309585    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" event={"ID":"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee","Type":"ContainerStarted","Data":"a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"}
Sep 12 03:00:34.309713 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.309680    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" event={"ID":"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee","Type":"ContainerStarted","Data":"3837ad478bb697923dded6218a8d7107cfefdeb3cd328c9d6ef69786808fb78f"}
Sep 12 03:00:34.892538 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:34.892501    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:35.897655 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:35.897617    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:35.918206 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:35.918155    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podStartSLOduration=2.918137665 podStartE2EDuration="2.918137665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:34.328051506 +0000 UTC m=+1466.584032520" watchObservedRunningTime="2026-09-12 03:00:35.918137665 +0000 UTC m=+1468.174118755"
Sep 12 03:00:36.324435 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:36.324368    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:36.325234 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:36.325212    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:00:40.690867 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.690837    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"]
Sep 12 03:00:40.694595 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.694576    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:40.696940 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.696918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-f91169-dockercfg-dtrcx\""
Sep 12 03:00:40.697059 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.696958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-f91169\""
Sep 12 03:00:40.701097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.701077    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"]
Sep 12 03:00:40.853633 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.853602    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7cgm\" (UniqueName: \"kubernetes.io/projected/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-kube-api-access-d7cgm\") pod \"payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:40.853813 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.853639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:40.954957 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.954868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7cgm\" (UniqueName: \"kubernetes.io/projected/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-kube-api-access-d7cgm\") pod \"payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:40.954957 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.954908    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:40.955638 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.955617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:40.978608 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:40.978582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7cgm\" (UniqueName: \"kubernetes.io/projected/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-kube-api-access-d7cgm\") pod \"payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:41.007224 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:41.007187    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:41.282108 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:41.282081    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"]
Sep 12 03:00:41.282771 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:00:41.282746    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5d5e74_675a_45a3_8872_ad9e5970a3c0.slice/crio-ed39672e59beb9ae72e01ab3f27698512db7487c17d3872ea0f723cf43fb4aac WatchSource:0}: Error finding container ed39672e59beb9ae72e01ab3f27698512db7487c17d3872ea0f723cf43fb4aac: Status 404 returned error can't find the container with id ed39672e59beb9ae72e01ab3f27698512db7487c17d3872ea0f723cf43fb4aac
Sep 12 03:00:41.362743 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:41.362713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf" event={"ID":"7b5d5e74-675a-45a3-8872-ad9e5970a3c0","Type":"ContainerStarted","Data":"ac06df3bb4b1a44fa43da75f215501c39dd5a332ce1b1331d4042ef14fc417f5"}
Sep 12 03:00:41.362851 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:41.362773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf" event={"ID":"7b5d5e74-675a-45a3-8872-ad9e5970a3c0","Type":"ContainerStarted","Data":"ed39672e59beb9ae72e01ab3f27698512db7487c17d3872ea0f723cf43fb4aac"}
Sep 12 03:00:41.362851 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:41.362804    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:00:41.378774 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:41.378729    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf" podStartSLOduration=1.378714501 podStartE2EDuration="1.378714501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:00:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:00:41.376941729 +0000 UTC m=+1473.632922746" watchObservedRunningTime="2026-09-12 03:00:41.378714501 +0000 UTC m=+1473.634695515"
Sep 12 03:00:52.370794 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:00:52.370764    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:01:07.052385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.052353    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"]
Sep 12 03:01:07.057577 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.057556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.060060 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.060038    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e401bd-openshift-default-dockercfg-dbdxh\""
Sep 12 03:01:07.067155 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.066877    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"]
Sep 12 03:01:07.118008 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.117971    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-credential-socket\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118175 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-socket\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118175 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-data\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118261 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118192    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-certs\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118261 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p9m2\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-kube-api-access-9p9m2\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118373 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118352    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-envoy\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118427 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118401    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-istio-token\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118468 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/380104eb-ba24-4bcb-81af-07ca57683002-istio-podinfo\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.118524 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.118510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/380104eb-ba24-4bcb-81af-07ca57683002-istiod-ca-cert\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220140 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-envoy\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220332 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-istio-token\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220332 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/380104eb-ba24-4bcb-81af-07ca57683002-istio-podinfo\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220508 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220471    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/380104eb-ba24-4bcb-81af-07ca57683002-istiod-ca-cert\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220533    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-credential-socket\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220630 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-socket\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220690 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220651    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-data\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.220749 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-certs\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.221155 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.220895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-credential-socket\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.221155 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.221078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-socket\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.221155 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.221101    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p9m2\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-kube-api-access-9p9m2\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.221155 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.221140    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-data\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.221536 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.221158    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/380104eb-ba24-4bcb-81af-07ca57683002-istiod-ca-cert\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.221536 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.221318    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-certs\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.222822 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.222798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-envoy\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.223220 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.223200    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/380104eb-ba24-4bcb-81af-07ca57683002-istio-podinfo\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.231236 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.231211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p9m2\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-kube-api-access-9p9m2\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.231381 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.231360    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-istio-token\") pod \"e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") " pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.366658 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.366613    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 12 03:01:07.366878 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.366724    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 12 03:01:07.370494 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.370465    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:07.647673 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.647643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"]
Sep 12 03:01:07.648114 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:01:07.648090    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380104eb_ba24_4bcb_81af_07ca57683002.slice/crio-0ea7e46cd420f301a9c77193a5e2c92d943f9955b610f8c34e06103f8c414d64 WatchSource:0}: Error finding container 0ea7e46cd420f301a9c77193a5e2c92d943f9955b610f8c34e06103f8c414d64: Status 404 returned error can't find the container with id 0ea7e46cd420f301a9c77193a5e2c92d943f9955b610f8c34e06103f8c414d64
Sep 12 03:01:07.650398 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.650368    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:07.650523 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.650458    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:07.650523 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:07.650507    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:08.441214 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.441182    2583 scope.go:117] "RemoveContainer" containerID="bb655cf541d1b897cbf7157023d0d9fafb80bd227846f7ede49302ccd9ad325f"
Sep 12 03:01:08.450510 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.450438    2583 scope.go:117] "RemoveContainer" containerID="c41ee5acec405a1bb51c79b308e95bd163d0df2a63a0e908990b3cff470e7d28"
Sep 12 03:01:08.572591 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.572547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" event={"ID":"380104eb-ba24-4bcb-81af-07ca57683002","Type":"ContainerStarted","Data":"2f2076d21c6e5aa0e196d5d671e47a043d7e945b4677f0e4260fb53817fc659f"}
Sep 12 03:01:08.572778 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.572617    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" event={"ID":"380104eb-ba24-4bcb-81af-07ca57683002","Type":"ContainerStarted","Data":"0ea7e46cd420f301a9c77193a5e2c92d943f9955b610f8c34e06103f8c414d64"}
Sep 12 03:01:08.594864 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.594816    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podStartSLOduration=1.594802558 podStartE2EDuration="1.594802558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:01:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:01:08.590372609 +0000 UTC m=+1500.846353632" watchObservedRunningTime="2026-09-12 03:01:08.594802558 +0000 UTC m=+1500.850783632"
Sep 12 03:01:08.671386 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.671351    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:01:08.672664 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.672638    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:01:08.675222 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.675202    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:01:08.676385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:08.676368    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:01:09.370952 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.370868    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:09.376360 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.376333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:09.580573 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.580538    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerID="a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878" exitCode=0
Sep 12 03:01:09.580938 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.580609    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" event={"ID":"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee","Type":"ContainerDied","Data":"a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"}
Sep 12 03:01:09.581066 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.581049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:09.581134 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.581101    2583 scope.go:117] "RemoveContainer" containerID="a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"
Sep 12 03:01:09.581908 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.581866    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:09.582230 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.582201    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:09.582306 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.582263    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:09.582346 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:09.582310    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:10.590085 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:10.590053    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" event={"ID":"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee","Type":"ContainerStarted","Data":"c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406"}
Sep 12 03:01:10.892656 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:10.892561    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:01:10.892827 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:10.892759    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 12 03:01:10.892900 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:10.892826    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 12 03:01:11.893024 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:11.892986    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 12 03:01:11.893440 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:11.893058    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 12 03:01:12.892699 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:12.892662    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 12 03:01:12.892873 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:12.892730    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 12 03:01:13.892880 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:13.892840    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 12 03:01:13.893258 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:13.892899    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 12 03:01:14.892529 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:14.892493    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 12 03:01:14.892688 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:14.892552    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 12 03:01:15.527673 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.527636    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"]
Sep 12 03:01:15.531990 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.531962    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.532127 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.532065    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"]
Sep 12 03:01:15.534360 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.534336    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e401bd-dockercfg-dq7kd\""
Sep 12 03:01:15.534515 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.534364    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e401bd\""
Sep 12 03:01:15.560220 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.560179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab21a089-15ff-408d-861f-fdc55a4a57e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.581425 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.581372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtxnk\" (UniqueName: \"kubernetes.io/projected/ab21a089-15ff-408d-861f-fdc55a4a57e3-kube-api-access-rtxnk\") pod \"payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.682704 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.682662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab21a089-15ff-408d-861f-fdc55a4a57e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.682704 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.682706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtxnk\" (UniqueName: \"kubernetes.io/projected/ab21a089-15ff-408d-861f-fdc55a4a57e3-kube-api-access-rtxnk\") pod \"payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.683345 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.683324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab21a089-15ff-408d-861f-fdc55a4a57e3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.689967 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.689932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtxnk\" (UniqueName: \"kubernetes.io/projected/ab21a089-15ff-408d-861f-fdc55a4a57e3-kube-api-access-rtxnk\") pod \"payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.845535 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.845499    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:15.898232 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.898207    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused" start-of-body=
Sep 12 03:01:15.898329 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:15.898259    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.91:15021/healthz/ready\": dial tcp 10.133.0.91:15021: connect: connection refused"
Sep 12 03:01:16.127498 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.127459    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"]
Sep 12 03:01:16.129590 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:01:16.129562    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab21a089_15ff_408d_861f_fdc55a4a57e3.slice/crio-0d7027e5729c880641b3b23041ea24574983daae3dbc97e07bd1f7730aca79c8 WatchSource:0}: Error finding container 0d7027e5729c880641b3b23041ea24574983daae3dbc97e07bd1f7730aca79c8: Status 404 returned error can't find the container with id 0d7027e5729c880641b3b23041ea24574983daae3dbc97e07bd1f7730aca79c8
Sep 12 03:01:16.647317 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.647271    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2" event={"ID":"ab21a089-15ff-408d-861f-fdc55a4a57e3","Type":"ContainerStarted","Data":"82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578"}
Sep 12 03:01:16.647801 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.647335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2" event={"ID":"ab21a089-15ff-408d-861f-fdc55a4a57e3","Type":"ContainerStarted","Data":"0d7027e5729c880641b3b23041ea24574983daae3dbc97e07bd1f7730aca79c8"}
Sep 12 03:01:16.647801 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.647548    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:16.662135 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.662091    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2" podStartSLOduration=1.6620758 podStartE2EDuration="1.6620758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:01:16.661750908 +0000 UTC m=+1508.917731924" watchObservedRunningTime="2026-09-12 03:01:16.6620758 +0000 UTC m=+1508.918056815"
Sep 12 03:01:16.896306 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.896275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:01:16.896668 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.896642    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:01:16.897247 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:16.897230    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:01:18.873442 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:18.873392    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"]
Sep 12 03:01:18.880183 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:18.880157    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:18.881917 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:18.881893    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"]
Sep 12 03:01:18.882762 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:18.882739    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:01:18.882887 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:18.882746    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:01:18.914384 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:18.914359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de95b58a-fd8e-4fda-8068-e624a8931c9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw\" (UID: \"de95b58a-fd8e-4fda-8068-e624a8931c9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:19.015648 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:19.015623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de95b58a-fd8e-4fda-8068-e624a8931c9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw\" (UID: \"de95b58a-fd8e-4fda-8068-e624a8931c9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:19.016160 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:19.016141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de95b58a-fd8e-4fda-8068-e624a8931c9f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw\" (UID: \"de95b58a-fd8e-4fda-8068-e624a8931c9f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:19.191526 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:19.191447    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:19.464279 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:19.464248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"]
Sep 12 03:01:19.465641 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:01:19.465610    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde95b58a_fd8e_4fda_8068_e624a8931c9f.slice/crio-b5c75c354a96e13fb437d93e7a65d8d8581afacc15f6b80b742afdcb422ab2b6 WatchSource:0}: Error finding container b5c75c354a96e13fb437d93e7a65d8d8581afacc15f6b80b742afdcb422ab2b6: Status 404 returned error can't find the container with id b5c75c354a96e13fb437d93e7a65d8d8581afacc15f6b80b742afdcb422ab2b6
Sep 12 03:01:19.667746 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:19.667717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw" event={"ID":"de95b58a-fd8e-4fda-8068-e624a8931c9f","Type":"ContainerStarted","Data":"b5c75c354a96e13fb437d93e7a65d8d8581afacc15f6b80b742afdcb422ab2b6"}
Sep 12 03:01:20.675385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:20.675350    2583 generic.go:356] "Generic (PLEG): container finished" podID="de95b58a-fd8e-4fda-8068-e624a8931c9f" containerID="fc4a377aca3dea307e888966000c510de1e2e02c2037cd616da3bdaafb46fcee" exitCode=0
Sep 12 03:01:20.675784 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:20.675436    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw" event={"ID":"de95b58a-fd8e-4fda-8068-e624a8931c9f","Type":"ContainerDied","Data":"fc4a377aca3dea307e888966000c510de1e2e02c2037cd616da3bdaafb46fcee"}
Sep 12 03:01:21.824182 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:21.824155    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:21.946979 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:21.946912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de95b58a-fd8e-4fda-8068-e624a8931c9f-maas-api-service-ca\") pod \"de95b58a-fd8e-4fda-8068-e624a8931c9f\" (UID: \"de95b58a-fd8e-4fda-8068-e624a8931c9f\") "
Sep 12 03:01:21.947299 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:21.947272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de95b58a-fd8e-4fda-8068-e624a8931c9f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "de95b58a-fd8e-4fda-8068-e624a8931c9f" (UID: "de95b58a-fd8e-4fda-8068-e624a8931c9f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:01:22.048230 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:22.048202    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de95b58a-fd8e-4fda-8068-e624a8931c9f-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:01:22.691572 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:22.691539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw" event={"ID":"de95b58a-fd8e-4fda-8068-e624a8931c9f","Type":"ContainerDied","Data":"b5c75c354a96e13fb437d93e7a65d8d8581afacc15f6b80b742afdcb422ab2b6"}
Sep 12 03:01:22.691572 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:22.691567    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"
Sep 12 03:01:22.691772 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:22.691584    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5c75c354a96e13fb437d93e7a65d8d8581afacc15f6b80b742afdcb422ab2b6"
Sep 12 03:01:27.655271 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:27.655240    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:01:35.598425 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.598209    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"]
Sep 12 03:01:35.598425 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.598279    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-1c9060bc-29819700-2nrk6"]
Sep 12 03:01:35.627884 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.627846    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"]
Sep 12 03:01:35.632515 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.632470    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn" podUID="dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" containerName="payload-pre-processing" containerID="cri-o://9aeaaa8eb566c76ec4b3591a06b4b7e2742186c63f6cbabbd4de0cacb3f4f025" gracePeriod=30
Sep 12 03:01:35.774447 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.774394    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"]
Sep 12 03:01:35.777863 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.777837    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1c9060bc-sqtgw"]
Sep 12 03:01:35.785639 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.785614    2583 generic.go:356] "Generic (PLEG): container finished" podID="dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" containerID="9aeaaa8eb566c76ec4b3591a06b4b7e2742186c63f6cbabbd4de0cacb3f4f025" exitCode=0
Sep 12 03:01:35.785757 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.785669    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn" event={"ID":"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456","Type":"ContainerDied","Data":"9aeaaa8eb566c76ec4b3591a06b4b7e2742186c63f6cbabbd4de0cacb3f4f025"}
Sep 12 03:01:35.971630 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:35.971608    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 03:01:36.086866 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.086832    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gfc9\" (UniqueName: \"kubernetes.io/projected/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-kube-api-access-8gfc9\") pod \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") "
Sep 12 03:01:36.087024 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.086939    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-plugins-config-volume\") pod \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\" (UID: \"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456\") "
Sep 12 03:01:36.087318 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.087295    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" (UID: "dc64fd8f-4b2f-40af-b3b7-7e7518e7d456"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:01:36.088894 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.088872    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-kube-api-access-8gfc9" (OuterVolumeSpecName: "kube-api-access-8gfc9") pod "dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" (UID: "dc64fd8f-4b2f-40af-b3b7-7e7518e7d456"). InnerVolumeSpecName "kube-api-access-8gfc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:01:36.162207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.162162    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="225e4129-25b7-48c5-8c6b-78c697b56eae" path="/var/lib/kubelet/pods/225e4129-25b7-48c5-8c6b-78c697b56eae/volumes"
Sep 12 03:01:36.162794 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.162769    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de95b58a-fd8e-4fda-8068-e624a8931c9f" path="/var/lib/kubelet/pods/de95b58a-fd8e-4fda-8068-e624a8931c9f/volumes"
Sep 12 03:01:36.188499 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.188471    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gfc9\" (UniqueName: \"kubernetes.io/projected/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-kube-api-access-8gfc9\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:01:36.188499 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.188494    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:01:36.793177 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.793148    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"
Sep 12 03:01:36.793593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.793175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn" event={"ID":"dc64fd8f-4b2f-40af-b3b7-7e7518e7d456","Type":"ContainerDied","Data":"7d6fc00d722002f96e80d100251144746b14f906277c36f0692a9f3dd97aaa95"}
Sep 12 03:01:36.793593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.793239    2583 scope.go:117] "RemoveContainer" containerID="9aeaaa8eb566c76ec4b3591a06b4b7e2742186c63f6cbabbd4de0cacb3f4f025"
Sep 12 03:01:36.812910 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.812873    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"]
Sep 12 03:01:36.820719 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:36.820662    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1c9060bc-69c9cc7478-nvrwn"]
Sep 12 03:01:38.162444 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:38.162394    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" path="/var/lib/kubelet/pods/dc64fd8f-4b2f-40af-b3b7-7e7518e7d456/volumes"
Sep 12 03:01:44.863034 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:44.862999    2583 generic.go:356] "Generic (PLEG): container finished" podID="380104eb-ba24-4bcb-81af-07ca57683002" containerID="2f2076d21c6e5aa0e196d5d671e47a043d7e945b4677f0e4260fb53817fc659f" exitCode=0
Sep 12 03:01:44.863559 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:44.863074    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" event={"ID":"380104eb-ba24-4bcb-81af-07ca57683002","Type":"ContainerDied","Data":"2f2076d21c6e5aa0e196d5d671e47a043d7e945b4677f0e4260fb53817fc659f"}
Sep 12 03:01:44.863701 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:44.863684    2583 scope.go:117] "RemoveContainer" containerID="2f2076d21c6e5aa0e196d5d671e47a043d7e945b4677f0e4260fb53817fc659f"
Sep 12 03:01:44.864891 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:44.864864    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:44.865003 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:44.864948    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:44.865065 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:44.865005    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:01:45.876009 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:45.875945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" event={"ID":"380104eb-ba24-4bcb-81af-07ca57683002","Type":"ContainerStarted","Data":"fc71db540214004f3fba5fe5cad7686fdb628bf7098464dde1b6af0e812e5922"}
Sep 12 03:01:46.371641 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:46.371598    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:46.371908 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:46.371882    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 03:01:46.372010 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:46.371959    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 03:01:47.371123 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:47.371085    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 03:01:47.371522 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:47.371149    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 03:01:48.372313 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:48.372279    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 03:01:48.372989 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:48.372959    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 03:01:49.370871 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:49.370836    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 03:01:49.371038 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:49.370893    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 03:01:50.371629 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:50.371590    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 03:01:50.372080 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:50.371654    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 03:01:51.371211 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:51.371175    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused" start-of-body=
Sep 12 03:01:51.371431 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:51.371235    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.93:15021/healthz/ready\": dial tcp 10.133.0.93:15021: connect: connection refused"
Sep 12 03:01:52.375724 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:52.375689    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:52.376164 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:52.375997    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:01:52.376745 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:01:52.376723    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:02:32.866004 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:32.865965    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"]
Sep 12 03:02:32.866477 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:32.866234    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy" containerID="cri-o://25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c" gracePeriod=30
Sep 12 03:02:38.134675 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.134616    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 03:02:38.236480 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236441    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwwk2\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-kube-api-access-lwwk2\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.236679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236493    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-data\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.236679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236518    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-credential-socket\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.236679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236555    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istiod-ca-cert\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.236679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236604    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-envoy\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.236679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-podinfo\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.236679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236677    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-socket\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.237005 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-token\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.237005 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236771    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-certs\") pod \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\" (UID: \"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2\") "
Sep 12 03:02:38.237005 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236849    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:02:38.237005 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.236862    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:02:38.237263 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237069    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:02:38.237263 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237119    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:02:38.237263 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237251    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:02:38.237454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237274    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.237454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237295    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.237454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237309    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.237454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.237322    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.238920 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.238886    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-kube-api-access-lwwk2" (OuterVolumeSpecName: "kube-api-access-lwwk2") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "kube-api-access-lwwk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:02:38.239034 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.238922    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:02:38.239034 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.238931    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:02:38.239034 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.238985    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" (UID: "4ccb7b0c-8c6b-4c0d-b605-75a6640721d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:02:38.256921 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.256895    2583 generic.go:356] "Generic (PLEG): container finished" podID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerID="25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c" exitCode=0
Sep 12 03:02:38.257028 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.256941    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"
Sep 12 03:02:38.257028 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.256935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" event={"ID":"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2","Type":"ContainerDied","Data":"25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c"}
Sep 12 03:02:38.257121 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.257051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg" event={"ID":"4ccb7b0c-8c6b-4c0d-b605-75a6640721d2","Type":"ContainerDied","Data":"05055e0135d02d6edb3e82ee7ff4c2b32c47a65e7dd14de1c9969e737cc1ed2a"}
Sep 12 03:02:38.257121 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.257072    2583 scope.go:117] "RemoveContainer" containerID="25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c"
Sep 12 03:02:38.267416 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.267391    2583 scope.go:117] "RemoveContainer" containerID="bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"
Sep 12 03:02:38.276499 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.276455    2583 scope.go:117] "RemoveContainer" containerID="25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c"
Sep 12 03:02:38.276772 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:02:38.276750    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c\": container with ID starting with 25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c not found: ID does not exist" containerID="25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c"
Sep 12 03:02:38.276813 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.276784    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c"} err="failed to get container status \"25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c\": rpc error: code = NotFound desc = could not find container \"25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c\": container with ID starting with 25dc7e59e08e75a981424264e52fde262f3cf00d5e978639c385a387583f4f8c not found: ID does not exist"
Sep 12 03:02:38.276813 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.276807    2583 scope.go:117] "RemoveContainer" containerID="bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"
Sep 12 03:02:38.277053 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:02:38.277035    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68\": container with ID starting with bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68 not found: ID does not exist" containerID="bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"
Sep 12 03:02:38.277112 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.277062    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68"} err="failed to get container status \"bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68\": rpc error: code = NotFound desc = could not find container \"bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68\": container with ID starting with bbb060f465229f256097f86271c77c1f1c4867b363541d5084007af40d77cd68 not found: ID does not exist"
Sep 12 03:02:38.279664 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.279638    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"]
Sep 12 03:02:38.282603 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.282584    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1c9060bc-openshift-default-585bf6d668-5zrtg"]
Sep 12 03:02:38.338804 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.338783    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.338804 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.338802    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.338926 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.338811    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.338926 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.338819    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:38.338926 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:38.338827    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwwk2\" (UniqueName: \"kubernetes.io/projected/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2-kube-api-access-lwwk2\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:02:40.162191 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:02:40.162156    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" path="/var/lib/kubelet/pods/4ccb7b0c-8c6b-4c0d-b605-75a6640721d2/volumes"
Sep 12 03:03:27.621543 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.621513    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"]
Sep 12 03:03:27.622282 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622259    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" containerName="payload-pre-processing"
Sep 12 03:03:27.622543 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622434    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" containerName="payload-pre-processing"
Sep 12 03:03:27.622695 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622563    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy"
Sep 12 03:03:27.622695 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622596    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy"
Sep 12 03:03:27.622695 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622618    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de95b58a-fd8e-4fda-8068-e624a8931c9f" containerName="revoke-keys"
Sep 12 03:03:27.622695 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622627    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="de95b58a-fd8e-4fda-8068-e624a8931c9f" containerName="revoke-keys"
Sep 12 03:03:27.622695 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622659    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy"
Sep 12 03:03:27.622695 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622669    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy"
Sep 12 03:03:27.623108 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622903    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy"
Sep 12 03:03:27.623108 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622922    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ccb7b0c-8c6b-4c0d-b605-75a6640721d2" containerName="istio-proxy"
Sep 12 03:03:27.623108 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622935    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc64fd8f-4b2f-40af-b3b7-7e7518e7d456" containerName="payload-pre-processing"
Sep 12 03:03:27.623108 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.622949    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="de95b58a-fd8e-4fda-8068-e624a8931c9f" containerName="revoke-keys"
Sep 12 03:03:27.626882 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.626864    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.629935 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.629908    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-69d2db-openshift-default-dockercfg-fmcx2\""
Sep 12 03:03:27.638652 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.638628    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"]
Sep 12 03:03:27.715828 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.715798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-credential-socket\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.715828 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.715828    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1506089-d089-4362-a428-3f61fec7273c-istiod-ca-cert\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716002 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.715874    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-socket\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716002 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.715917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1506089-d089-4362-a428-3f61fec7273c-istio-podinfo\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716002 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.715966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-certs\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716002 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.715985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-557r8\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-kube-api-access-557r8\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716139 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.716008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-data\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716139 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.716099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-istio-token\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.716139 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.716130    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-envoy\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.816953 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.816921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-credential-socket\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.816953 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.816952    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1506089-d089-4362-a428-3f61fec7273c-istiod-ca-cert\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817142 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.816997    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-socket\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817142 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1506089-d089-4362-a428-3f61fec7273c-istio-podinfo\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817142 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-certs\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817142 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-557r8\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-kube-api-access-557r8\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817352 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-data\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817352 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817315    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-credential-socket\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817483 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-istio-token\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817483 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-socket\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817483 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-envoy\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817640 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817609    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-certs\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817699 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817634    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-data\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.817800 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.817773    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1506089-d089-4362-a428-3f61fec7273c-istiod-ca-cert\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.819542 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.819521    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1506089-d089-4362-a428-3f61fec7273c-istio-podinfo\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.819634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.819544    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-envoy\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.824389 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.824362    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-istio-token\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.824530 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.824512    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-557r8\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-kube-api-access-557r8\") pod \"e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") " pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:27.941120 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:27.941045    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:28.216781 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.216742    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"]
Sep 12 03:03:28.217902 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:03:28.217871    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1506089_d089_4362_a428_3f61fec7273c.slice/crio-2e9c70e30e1f8971977441cbad582a719bbe76277dea78502efb39e41f987f51 WatchSource:0}: Error finding container 2e9c70e30e1f8971977441cbad582a719bbe76277dea78502efb39e41f987f51: Status 404 returned error can't find the container with id 2e9c70e30e1f8971977441cbad582a719bbe76277dea78502efb39e41f987f51
Sep 12 03:03:28.226854 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.221358    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:03:28.226854 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.221543    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:03:28.226854 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.221627    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:03:28.596298 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.596256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" event={"ID":"d1506089-d089-4362-a428-3f61fec7273c","Type":"ContainerStarted","Data":"7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"}
Sep 12 03:03:28.596512 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.596345    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" event={"ID":"d1506089-d089-4362-a428-3f61fec7273c","Type":"ContainerStarted","Data":"2e9c70e30e1f8971977441cbad582a719bbe76277dea78502efb39e41f987f51"}
Sep 12 03:03:28.616737 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.616690    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podStartSLOduration=1.616673908 podStartE2EDuration="1.616673908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:03:28.61289632 +0000 UTC m=+1640.868877340" watchObservedRunningTime="2026-09-12 03:03:28.616673908 +0000 UTC m=+1640.872654922"
Sep 12 03:03:28.941983 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:28.941906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:29.947216 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:29.947187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:30.610122 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:30.610084    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:30.611096 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:30.611077    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:03:35.604357 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.604326    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"]
Sep 12 03:03:35.608332 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.608316    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.610621 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.610603    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-69d2db-dockercfg-xpjlk\""
Sep 12 03:03:35.610730 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.610604    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-69d2db\""
Sep 12 03:03:35.616952 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.616932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"]
Sep 12 03:03:35.705732 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.705465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54wvt\" (UniqueName: \"kubernetes.io/projected/f4f90224-75fe-4133-a06e-a77c576f0dfe-kube-api-access-54wvt\") pod \"payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") " pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.705732 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.705554    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4f90224-75fe-4133-a06e-a77c576f0dfe-plugins-config-volume\") pod \"payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") " pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.807152 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.807118    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54wvt\" (UniqueName: \"kubernetes.io/projected/f4f90224-75fe-4133-a06e-a77c576f0dfe-kube-api-access-54wvt\") pod \"payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") " pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.807351 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.807171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4f90224-75fe-4133-a06e-a77c576f0dfe-plugins-config-volume\") pod \"payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") " pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.807901 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.807881    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4f90224-75fe-4133-a06e-a77c576f0dfe-plugins-config-volume\") pod \"payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") " pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.814632 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.814607    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54wvt\" (UniqueName: \"kubernetes.io/projected/f4f90224-75fe-4133-a06e-a77c576f0dfe-kube-api-access-54wvt\") pod \"payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") " pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:35.921669 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:35.921592    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:36.197004 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:36.196975    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"]
Sep 12 03:03:36.197213 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:03:36.197181    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f90224_75fe_4133_a06e_a77c576f0dfe.slice/crio-384c01dc7f4fa3f708fa38dc1b050e2d72d159458f763d28934c254abae23001 WatchSource:0}: Error finding container 384c01dc7f4fa3f708fa38dc1b050e2d72d159458f763d28934c254abae23001: Status 404 returned error can't find the container with id 384c01dc7f4fa3f708fa38dc1b050e2d72d159458f763d28934c254abae23001
Sep 12 03:03:36.650043 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:36.650007    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f" event={"ID":"f4f90224-75fe-4133-a06e-a77c576f0dfe","Type":"ContainerStarted","Data":"81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69"}
Sep 12 03:03:36.650459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:36.650067    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f" event={"ID":"f4f90224-75fe-4133-a06e-a77c576f0dfe","Type":"ContainerStarted","Data":"384c01dc7f4fa3f708fa38dc1b050e2d72d159458f763d28934c254abae23001"}
Sep 12 03:03:36.650459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:36.650127    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:36.667937 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:36.667893    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f" podStartSLOduration=1.667880794 podStartE2EDuration="1.667880794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:03:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:03:36.664629895 +0000 UTC m=+1648.920610909" watchObservedRunningTime="2026-09-12 03:03:36.667880794 +0000 UTC m=+1648.923861857"
Sep 12 03:03:47.658585 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:47.658554    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:03:56.421266 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.421231    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"]
Sep 12 03:03:56.425137 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.425117    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:03:56.429006 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.428571    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:03:56.429006 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.428808    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:03:56.432087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.432065    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"]
Sep 12 03:03:56.514447 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.514384    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c202f00-a925-49e2-826b-14f9b238236d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f\" (UID: \"3c202f00-a925-49e2-826b-14f9b238236d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:03:56.615202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.615159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c202f00-a925-49e2-826b-14f9b238236d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f\" (UID: \"3c202f00-a925-49e2-826b-14f9b238236d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:03:56.615852 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.615828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c202f00-a925-49e2-826b-14f9b238236d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f\" (UID: \"3c202f00-a925-49e2-826b-14f9b238236d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:03:56.740444 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:56.740336    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:03:57.018187 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:57.018152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"]
Sep 12 03:03:57.018621 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:03:57.018600    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c202f00_a925_49e2_826b_14f9b238236d.slice/crio-b080e0baea8e597f399922926d84c1a53ad53d91cd8b5d206c31b87a4ef05325 WatchSource:0}: Error finding container b080e0baea8e597f399922926d84c1a53ad53d91cd8b5d206c31b87a4ef05325: Status 404 returned error can't find the container with id b080e0baea8e597f399922926d84c1a53ad53d91cd8b5d206c31b87a4ef05325
Sep 12 03:03:57.803826 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:57.803790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f" event={"ID":"3c202f00-a925-49e2-826b-14f9b238236d","Type":"ContainerStarted","Data":"93e5aed0699cc621e90c95a5790ada362a90c6809674ca26b44ac4702ce5fc5f"}
Sep 12 03:03:57.804247 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:57.803853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f" event={"ID":"3c202f00-a925-49e2-826b-14f9b238236d","Type":"ContainerStarted","Data":"b080e0baea8e597f399922926d84c1a53ad53d91cd8b5d206c31b87a4ef05325"}
Sep 12 03:03:57.820801 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:57.820756    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f" podStartSLOduration=1.820741463 podStartE2EDuration="1.820741463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:03:57.819794645 +0000 UTC m=+1670.075775664" watchObservedRunningTime="2026-09-12 03:03:57.820741463 +0000 UTC m=+1670.076722478"
Sep 12 03:03:58.812014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:58.811971    2583 generic.go:356] "Generic (PLEG): container finished" podID="3c202f00-a925-49e2-826b-14f9b238236d" containerID="93e5aed0699cc621e90c95a5790ada362a90c6809674ca26b44ac4702ce5fc5f" exitCode=0
Sep 12 03:03:58.812497 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:58.812112    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f" event={"ID":"3c202f00-a925-49e2-826b-14f9b238236d","Type":"ContainerDied","Data":"93e5aed0699cc621e90c95a5790ada362a90c6809674ca26b44ac4702ce5fc5f"}
Sep 12 03:03:59.820887 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.820847    2583 generic.go:356] "Generic (PLEG): container finished" podID="d1506089-d089-4362-a428-3f61fec7273c" containerID="7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0" exitCode=0
Sep 12 03:03:59.821336 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.820925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" event={"ID":"d1506089-d089-4362-a428-3f61fec7273c","Type":"ContainerDied","Data":"7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"}
Sep 12 03:03:59.821422 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.821389    2583 scope.go:117] "RemoveContainer" containerID="7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"
Sep 12 03:03:59.822645 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.822617    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:03:59.822776 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.822706    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:03:59.822776 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.822757    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 12 03:03:59.976288 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:03:59.976262    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:04:00.051767 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.051731    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c202f00-a925-49e2-826b-14f9b238236d-maas-api-service-ca\") pod \"3c202f00-a925-49e2-826b-14f9b238236d\" (UID: \"3c202f00-a925-49e2-826b-14f9b238236d\") "
Sep 12 03:04:00.052129 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.052104    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c202f00-a925-49e2-826b-14f9b238236d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c202f00-a925-49e2-826b-14f9b238236d" (UID: "3c202f00-a925-49e2-826b-14f9b238236d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:04:00.153343 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.153264    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c202f00-a925-49e2-826b-14f9b238236d-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:00.610229 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.610186    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:04:00.830825 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.830793    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"
Sep 12 03:04:00.831255 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.830826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f" event={"ID":"3c202f00-a925-49e2-826b-14f9b238236d","Type":"ContainerDied","Data":"b080e0baea8e597f399922926d84c1a53ad53d91cd8b5d206c31b87a4ef05325"}
Sep 12 03:04:00.831255 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.830874    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b080e0baea8e597f399922926d84c1a53ad53d91cd8b5d206c31b87a4ef05325"
Sep 12 03:04:00.832940 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.832915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" event={"ID":"d1506089-d089-4362-a428-3f61fec7273c","Type":"ContainerStarted","Data":"89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c"}
Sep 12 03:04:00.941878 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.941792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:04:00.943229 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.943204    2583 patch_prober.go:28] interesting pod/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 12 03:04:00.943349 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:00.943253    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 12 03:04:01.941632 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:01.941594    2583 patch_prober.go:28] interesting pod/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 12 03:04:01.942026 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:01.941647    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 12 03:04:02.942027 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:02.941990    2583 patch_prober.go:28] interesting pod/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 12 03:04:02.942399 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:02.942047    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 12 03:04:03.943451 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:03.943009    2583 patch_prober.go:28] interesting pod/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 12 03:04:03.943451 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:03.943088    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 12 03:04:04.941748 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:04.941713    2583 patch_prober.go:28] interesting pod/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 12 03:04:04.941920 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:04.941784    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 12 03:04:05.979715 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:05.979676    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:04:05.980353 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:05.980319    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:04:05.981861 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:05.981839    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:04:08.516510 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:08.516475    2583 scope.go:117] "RemoveContainer" containerID="485d3fae40f25457b8606fa6bbfd51d84ae43f0e050435ff0b1c237f519c8167"
Sep 12 03:04:08.525722 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:08.525702    2583 scope.go:117] "RemoveContainer" containerID="24a545b7daae5a1ece87f6a02708919cca608f5e4b06a8376989914372b0b85a"
Sep 12 03:04:11.339634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.339599    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"]
Sep 12 03:04:11.340109 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.340096    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c202f00-a925-49e2-826b-14f9b238236d" containerName="revoke-keys"
Sep 12 03:04:11.340164 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.340110    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c202f00-a925-49e2-826b-14f9b238236d" containerName="revoke-keys"
Sep 12 03:04:11.340205 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.340197    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c202f00-a925-49e2-826b-14f9b238236d" containerName="revoke-keys"
Sep 12 03:04:11.342379 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.342364    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.346796 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.346775    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-abddb9\""
Sep 12 03:04:11.346914 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.346818    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-abddb9-dockercfg-78ng8\""
Sep 12 03:04:11.362738 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.362691    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"]
Sep 12 03:04:11.373610 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.373582    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"]
Sep 12 03:04:11.376371 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.376340    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.386028 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.386003    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"]
Sep 12 03:04:11.475428 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.474865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgfz7\" (UniqueName: \"kubernetes.io/projected/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-kube-api-access-sgfz7\") pod \"payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.475428 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.475009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.475428 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.475075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e144c-71ae-4352-86e1-40dc56643a15-plugins-config-volume\") pod \"payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") " pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.475428 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.475113    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r22c7\" (UniqueName: \"kubernetes.io/projected/497e144c-71ae-4352-86e1-40dc56643a15-kube-api-access-r22c7\") pod \"payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") " pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.576211 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.576177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e144c-71ae-4352-86e1-40dc56643a15-plugins-config-volume\") pod \"payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") " pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.576371 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.576218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r22c7\" (UniqueName: \"kubernetes.io/projected/497e144c-71ae-4352-86e1-40dc56643a15-kube-api-access-r22c7\") pod \"payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") " pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.576371 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.576290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgfz7\" (UniqueName: \"kubernetes.io/projected/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-kube-api-access-sgfz7\") pod \"payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.576371 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.576362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.576910 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.576888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e144c-71ae-4352-86e1-40dc56643a15-plugins-config-volume\") pod \"payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") " pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.577016 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.576999    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.587640 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.587618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgfz7\" (UniqueName: \"kubernetes.io/projected/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-kube-api-access-sgfz7\") pod \"payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.587785 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.587769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r22c7\" (UniqueName: \"kubernetes.io/projected/497e144c-71ae-4352-86e1-40dc56643a15-kube-api-access-r22c7\") pod \"payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") " pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.653549 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.653477    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:11.688305 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.688269    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:11.928346 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.928318    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"]
Sep 12 03:04:11.929297 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:04:11.929268    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6b5416_2d8c_4f2e_b7ae_e6d6365709a5.slice/crio-1998c3bc06936f18e62c0ccdb5b372c87af202463a4c9186fc496b5568506156 WatchSource:0}: Error finding container 1998c3bc06936f18e62c0ccdb5b372c87af202463a4c9186fc496b5568506156: Status 404 returned error can't find the container with id 1998c3bc06936f18e62c0ccdb5b372c87af202463a4c9186fc496b5568506156
Sep 12 03:04:11.976154 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:11.976134    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"]
Sep 12 03:04:11.983667 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:04:11.983639    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497e144c_71ae_4352_86e1_40dc56643a15.slice/crio-87f508160374f2fea2a10d92015c97599d290d9b0f687bb3ae92601aae0801d3 WatchSource:0}: Error finding container 87f508160374f2fea2a10d92015c97599d290d9b0f687bb3ae92601aae0801d3: Status 404 returned error can't find the container with id 87f508160374f2fea2a10d92015c97599d290d9b0f687bb3ae92601aae0801d3
Sep 12 03:04:12.916967 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.916930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq" event={"ID":"497e144c-71ae-4352-86e1-40dc56643a15","Type":"ContainerStarted","Data":"5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f"}
Sep 12 03:04:12.917458 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.916991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq" event={"ID":"497e144c-71ae-4352-86e1-40dc56643a15","Type":"ContainerStarted","Data":"87f508160374f2fea2a10d92015c97599d290d9b0f687bb3ae92601aae0801d3"}
Sep 12 03:04:12.917458 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.917121    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:12.918611 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.918588    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph" event={"ID":"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5","Type":"ContainerStarted","Data":"e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801"}
Sep 12 03:04:12.918730 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.918626    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph" event={"ID":"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5","Type":"ContainerStarted","Data":"1998c3bc06936f18e62c0ccdb5b372c87af202463a4c9186fc496b5568506156"}
Sep 12 03:04:12.918730 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.918672    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:12.933277 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.933239    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq" podStartSLOduration=1.933226289 podStartE2EDuration="1.933226289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:04:12.932397612 +0000 UTC m=+1685.188378628" watchObservedRunningTime="2026-09-12 03:04:12.933226289 +0000 UTC m=+1685.189207303"
Sep 12 03:04:12.950636 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:12.950596    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph" podStartSLOduration=1.95058358 podStartE2EDuration="1.95058358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:04:12.947300421 +0000 UTC m=+1685.203281437" watchObservedRunningTime="2026-09-12 03:04:12.95058358 +0000 UTC m=+1685.206564618"
Sep 12 03:04:16.677653 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.677608    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"]
Sep 12 03:04:16.678116 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.677836    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b" podUID="ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" containerName="payload-pre-processing" containerID="cri-o://d12f1d41e684358f8f4be204b84adcfc85b07027b2b8d36529a7bf1378124b0f" gracePeriod=30
Sep 12 03:04:16.928310 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.928218    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"]
Sep 12 03:04:16.937080 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.937055    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-b0573c-jxx2f"]
Sep 12 03:04:16.950345 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.950319    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" containerID="d12f1d41e684358f8f4be204b84adcfc85b07027b2b8d36529a7bf1378124b0f" exitCode=0
Sep 12 03:04:16.950513 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.950394    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b" event={"ID":"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd","Type":"ContainerDied","Data":"d12f1d41e684358f8f4be204b84adcfc85b07027b2b8d36529a7bf1378124b0f"}
Sep 12 03:04:16.982169 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:16.982134    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 03:04:17.136738 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.136708    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcq29\" (UniqueName: \"kubernetes.io/projected/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-kube-api-access-fcq29\") pod \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") "
Sep 12 03:04:17.136899 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.136803    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-plugins-config-volume\") pod \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\" (UID: \"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd\") "
Sep 12 03:04:17.137178 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.137157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" (UID: "ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:04:17.138858 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.138835    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-kube-api-access-fcq29" (OuterVolumeSpecName: "kube-api-access-fcq29") pod "ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" (UID: "ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd"). InnerVolumeSpecName "kube-api-access-fcq29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:04:17.238500 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.238398    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcq29\" (UniqueName: \"kubernetes.io/projected/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-kube-api-access-fcq29\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:17.238500 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.238454    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:17.958013 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.957984    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"
Sep 12 03:04:17.958502 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.958022    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b" event={"ID":"ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd","Type":"ContainerDied","Data":"57d51880889e849abdcd9be2bd7b7d1f00e8b6a203c8df4329e26d91fcd5ef03"}
Sep 12 03:04:17.958502 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.958167    2583 scope.go:117] "RemoveContainer" containerID="d12f1d41e684358f8f4be204b84adcfc85b07027b2b8d36529a7bf1378124b0f"
Sep 12 03:04:17.985893 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.985866    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"]
Sep 12 03:04:17.988916 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:17.988892    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0573c-6445b96646-tcv8b"]
Sep 12 03:04:18.162801 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:18.162773    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c202f00-a925-49e2-826b-14f9b238236d" path="/var/lib/kubelet/pods/3c202f00-a925-49e2-826b-14f9b238236d/volumes"
Sep 12 03:04:18.163127 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:18.163114    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" path="/var/lib/kubelet/pods/ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd/volumes"
Sep 12 03:04:23.927361 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:23.927330    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:04:23.927846 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:23.927400    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:04:32.974210 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.974133    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"]
Sep 12 03:04:32.974697 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.974675    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" containerName="payload-pre-processing"
Sep 12 03:04:32.974697 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.974698    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" containerName="payload-pre-processing"
Sep 12 03:04:32.974782 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.974775    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9f5210-3d05-4b46-a6fe-ddd7c6b9f3bd" containerName="payload-pre-processing"
Sep 12 03:04:32.979203 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.979189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:32.981655 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.981632    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:04:32.981784 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.981632    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:04:32.984795 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:32.984761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"]
Sep 12 03:04:33.098676 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:33.098645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1735e1d-573e-4883-b669-300c9f2644b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k\" (UID: \"a1735e1d-573e-4883-b669-300c9f2644b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:33.199912 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:33.199876    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1735e1d-573e-4883-b669-300c9f2644b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k\" (UID: \"a1735e1d-573e-4883-b669-300c9f2644b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:33.200500 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:33.200480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1735e1d-573e-4883-b669-300c9f2644b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k\" (UID: \"a1735e1d-573e-4883-b669-300c9f2644b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:33.292570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:33.292505    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:33.569159 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:33.569128    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"]
Sep 12 03:04:33.569875 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:04:33.569852    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1735e1d_573e_4883_b669_300c9f2644b6.slice/crio-e4ad89044b73039717acf7784c09cce0a691eac5dc8cda2eb2b2b45fc28280ec WatchSource:0}: Error finding container e4ad89044b73039717acf7784c09cce0a691eac5dc8cda2eb2b2b45fc28280ec: Status 404 returned error can't find the container with id e4ad89044b73039717acf7784c09cce0a691eac5dc8cda2eb2b2b45fc28280ec
Sep 12 03:04:34.067566 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:34.067525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k" event={"ID":"a1735e1d-573e-4883-b669-300c9f2644b6","Type":"ContainerStarted","Data":"2efba0605b9a1bbeb8f535a4ffab99eb7714fd246fa3d58cf5f9344fe4569811"}
Sep 12 03:04:34.067937 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:34.067590    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k" event={"ID":"a1735e1d-573e-4883-b669-300c9f2644b6","Type":"ContainerStarted","Data":"e4ad89044b73039717acf7784c09cce0a691eac5dc8cda2eb2b2b45fc28280ec"}
Sep 12 03:04:34.087476 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:34.087398    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k" podStartSLOduration=2.087381621 podStartE2EDuration="2.087381621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:04:34.086819761 +0000 UTC m=+1706.342800778" watchObservedRunningTime="2026-09-12 03:04:34.087381621 +0000 UTC m=+1706.343362635"
Sep 12 03:04:35.076232 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:35.076200    2583 generic.go:356] "Generic (PLEG): container finished" podID="a1735e1d-573e-4883-b669-300c9f2644b6" containerID="2efba0605b9a1bbeb8f535a4ffab99eb7714fd246fa3d58cf5f9344fe4569811" exitCode=0
Sep 12 03:04:35.076642 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:35.076287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k" event={"ID":"a1735e1d-573e-4883-b669-300c9f2644b6","Type":"ContainerDied","Data":"2efba0605b9a1bbeb8f535a4ffab99eb7714fd246fa3d58cf5f9344fe4569811"}
Sep 12 03:04:36.226487 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:36.226465    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:36.329612 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:36.329583    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1735e1d-573e-4883-b669-300c9f2644b6-maas-api-service-ca\") pod \"a1735e1d-573e-4883-b669-300c9f2644b6\" (UID: \"a1735e1d-573e-4883-b669-300c9f2644b6\") "
Sep 12 03:04:36.329916 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:36.329895    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1735e1d-573e-4883-b669-300c9f2644b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1735e1d-573e-4883-b669-300c9f2644b6" (UID: "a1735e1d-573e-4883-b669-300c9f2644b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:04:36.431134 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:36.431061    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1735e1d-573e-4883-b669-300c9f2644b6-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:37.091110 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:37.091079    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"
Sep 12 03:04:37.091283 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:37.091117    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k" event={"ID":"a1735e1d-573e-4883-b669-300c9f2644b6","Type":"ContainerDied","Data":"e4ad89044b73039717acf7784c09cce0a691eac5dc8cda2eb2b2b45fc28280ec"}
Sep 12 03:04:37.091283 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:37.091163    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4ad89044b73039717acf7784c09cce0a691eac5dc8cda2eb2b2b45fc28280ec"
Sep 12 03:04:48.879752 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:48.879711    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"]
Sep 12 03:04:48.880222 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:48.879936    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f" podUID="f4f90224-75fe-4133-a06e-a77c576f0dfe" containerName="payload-processing" containerID="cri-o://81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69" gracePeriod=30
Sep 12 03:04:49.043396 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.043350    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"]
Sep 12 03:04:49.046259 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.046237    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-69d2db-ffq8k"]
Sep 12 03:04:49.142767 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.142715    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:04:49.174930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.174899    2583 generic.go:356] "Generic (PLEG): container finished" podID="f4f90224-75fe-4133-a06e-a77c576f0dfe" containerID="81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69" exitCode=0
Sep 12 03:04:49.175059 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.174941    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"
Sep 12 03:04:49.175059 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.174981    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f" event={"ID":"f4f90224-75fe-4133-a06e-a77c576f0dfe","Type":"ContainerDied","Data":"81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69"}
Sep 12 03:04:49.175059 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.175031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f" event={"ID":"f4f90224-75fe-4133-a06e-a77c576f0dfe","Type":"ContainerDied","Data":"384c01dc7f4fa3f708fa38dc1b050e2d72d159458f763d28934c254abae23001"}
Sep 12 03:04:49.175059 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.175058    2583 scope.go:117] "RemoveContainer" containerID="81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69"
Sep 12 03:04:49.185634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.185613    2583 scope.go:117] "RemoveContainer" containerID="81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69"
Sep 12 03:04:49.185935 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:04:49.185915    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69\": container with ID starting with 81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69 not found: ID does not exist" containerID="81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69"
Sep 12 03:04:49.186032 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.185944    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69"} err="failed to get container status \"81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69\": rpc error: code = NotFound desc = could not find container \"81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69\": container with ID starting with 81dd608769168e72a265653a19fa46c7e7f129fa43fd8ba2e0e11c1aed77dc69 not found: ID does not exist"
Sep 12 03:04:49.262277 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.262245    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54wvt\" (UniqueName: \"kubernetes.io/projected/f4f90224-75fe-4133-a06e-a77c576f0dfe-kube-api-access-54wvt\") pod \"f4f90224-75fe-4133-a06e-a77c576f0dfe\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") "
Sep 12 03:04:49.262505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.262311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4f90224-75fe-4133-a06e-a77c576f0dfe-plugins-config-volume\") pod \"f4f90224-75fe-4133-a06e-a77c576f0dfe\" (UID: \"f4f90224-75fe-4133-a06e-a77c576f0dfe\") "
Sep 12 03:04:49.262727 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.262702    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4f90224-75fe-4133-a06e-a77c576f0dfe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4f90224-75fe-4133-a06e-a77c576f0dfe" (UID: "f4f90224-75fe-4133-a06e-a77c576f0dfe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:04:49.264484 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.264457    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f90224-75fe-4133-a06e-a77c576f0dfe-kube-api-access-54wvt" (OuterVolumeSpecName: "kube-api-access-54wvt") pod "f4f90224-75fe-4133-a06e-a77c576f0dfe" (UID: "f4f90224-75fe-4133-a06e-a77c576f0dfe"). InnerVolumeSpecName "kube-api-access-54wvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:04:49.363952 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.363903    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54wvt\" (UniqueName: \"kubernetes.io/projected/f4f90224-75fe-4133-a06e-a77c576f0dfe-kube-api-access-54wvt\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:49.363952 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.363937    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4f90224-75fe-4133-a06e-a77c576f0dfe-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:49.497877 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.497850    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"]
Sep 12 03:04:49.503698 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:49.503674    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-69d2db-5c7f85597-b4s4f"]
Sep 12 03:04:50.162639 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:50.162602    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1735e1d-573e-4883-b669-300c9f2644b6" path="/var/lib/kubelet/pods/a1735e1d-573e-4883-b669-300c9f2644b6/volumes"
Sep 12 03:04:50.163010 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:50.162996    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f90224-75fe-4133-a06e-a77c576f0dfe" path="/var/lib/kubelet/pods/f4f90224-75fe-4133-a06e-a77c576f0dfe/volumes"
Sep 12 03:04:55.444441 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.444373    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"]
Sep 12 03:04:55.444975 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.444623    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy" containerID="cri-o://89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c" gracePeriod=30
Sep 12 03:04:55.855473 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.855431    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"]
Sep 12 03:04:55.855933 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.855920    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f90224-75fe-4133-a06e-a77c576f0dfe" containerName="payload-processing"
Sep 12 03:04:55.855978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.855936    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f90224-75fe-4133-a06e-a77c576f0dfe" containerName="payload-processing"
Sep 12 03:04:55.855978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.855949    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1735e1d-573e-4883-b669-300c9f2644b6" containerName="revoke-keys"
Sep 12 03:04:55.855978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.855956    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1735e1d-573e-4883-b669-300c9f2644b6" containerName="revoke-keys"
Sep 12 03:04:55.856078 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.856047    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f90224-75fe-4133-a06e-a77c576f0dfe" containerName="payload-processing"
Sep 12 03:04:55.856078 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.856056    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1735e1d-573e-4883-b669-300c9f2644b6" containerName="revoke-keys"
Sep 12 03:04:55.860567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.860547    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:55.862942 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.862920    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:04:55.863059 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.862923    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:04:55.865375 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.865356    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"]
Sep 12 03:04:55.935562 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:55.935536    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07730842-9fa1-4ab0-a83e-4b5b3493c877-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4\" (UID: \"07730842-9fa1-4ab0-a83e-4b5b3493c877\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:56.036603 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:56.036569    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07730842-9fa1-4ab0-a83e-4b5b3493c877-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4\" (UID: \"07730842-9fa1-4ab0-a83e-4b5b3493c877\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:56.037190 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:56.037164    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07730842-9fa1-4ab0-a83e-4b5b3493c877-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4\" (UID: \"07730842-9fa1-4ab0-a83e-4b5b3493c877\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:56.173489 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:56.173399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:56.451099 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:56.451062    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"]
Sep 12 03:04:56.451640 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:04:56.451619    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07730842_9fa1_4ab0_a83e_4b5b3493c877.slice/crio-d8ec010af462b3dc7a3ef5c13dc21905467f4a5089449c68c05a9635b7050572 WatchSource:0}: Error finding container d8ec010af462b3dc7a3ef5c13dc21905467f4a5089449c68c05a9635b7050572: Status 404 returned error can't find the container with id d8ec010af462b3dc7a3ef5c13dc21905467f4a5089449c68c05a9635b7050572
Sep 12 03:04:57.240429 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:57.240388    2583 generic.go:356] "Generic (PLEG): container finished" podID="07730842-9fa1-4ab0-a83e-4b5b3493c877" containerID="b5c8902c321918b874e3070cb1c140de67a321183310ded2cdeb37c6168a4019" exitCode=0
Sep 12 03:04:57.240586 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:57.240453    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4" event={"ID":"07730842-9fa1-4ab0-a83e-4b5b3493c877","Type":"ContainerDied","Data":"b5c8902c321918b874e3070cb1c140de67a321183310ded2cdeb37c6168a4019"}
Sep 12 03:04:57.240586 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:57.240516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4" event={"ID":"07730842-9fa1-4ab0-a83e-4b5b3493c877","Type":"ContainerStarted","Data":"d8ec010af462b3dc7a3ef5c13dc21905467f4a5089449c68c05a9635b7050572"}
Sep 12 03:04:58.404207 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:58.404181    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:58.462160 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:58.462129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07730842-9fa1-4ab0-a83e-4b5b3493c877-maas-api-service-ca\") pod \"07730842-9fa1-4ab0-a83e-4b5b3493c877\" (UID: \"07730842-9fa1-4ab0-a83e-4b5b3493c877\") "
Sep 12 03:04:58.462503 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:58.462483    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07730842-9fa1-4ab0-a83e-4b5b3493c877-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "07730842-9fa1-4ab0-a83e-4b5b3493c877" (UID: "07730842-9fa1-4ab0-a83e-4b5b3493c877"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:04:58.563842 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:58.563816    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07730842-9fa1-4ab0-a83e-4b5b3493c877-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:04:59.254751 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:59.254715    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4" event={"ID":"07730842-9fa1-4ab0-a83e-4b5b3493c877","Type":"ContainerDied","Data":"d8ec010af462b3dc7a3ef5c13dc21905467f4a5089449c68c05a9635b7050572"}
Sep 12 03:04:59.254751 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:59.254746    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"
Sep 12 03:04:59.254957 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:04:59.254764    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d8ec010af462b3dc7a3ef5c13dc21905467f4a5089449c68c05a9635b7050572"
Sep 12 03:05:00.726489 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.726462    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:05:00.786673 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786644    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-certs\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.786836 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786708    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-socket\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.786836 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786754    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-557r8\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-kube-api-access-557r8\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.786836 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786776    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-envoy\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.786836 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786805    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-data\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.787056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786870    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-credential-socket\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.787056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786936    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1506089-d089-4362-a428-3f61fec7273c-istio-podinfo\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.787056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786943    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:00.787056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786964    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1506089-d089-4362-a428-3f61fec7273c-istiod-ca-cert\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.787056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786965    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:00.787056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.786991    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-istio-token\") pod \"d1506089-d089-4362-a428-3f61fec7273c\" (UID: \"d1506089-d089-4362-a428-3f61fec7273c\") "
Sep 12 03:05:00.787350 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787174    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:00.787350 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787297    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1506089-d089-4362-a428-3f61fec7273c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:00.787570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787461    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:00.787570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787543    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1506089-d089-4362-a428-3f61fec7273c-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.787570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787562    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.787735 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787575    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.787735 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.787587    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.788929 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.788904    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:00.789113 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.789087    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1506089-d089-4362-a428-3f61fec7273c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:05:00.789113 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.789092    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-kube-api-access-557r8" (OuterVolumeSpecName: "kube-api-access-557r8") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "kube-api-access-557r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:00.789237 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.789121    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1506089-d089-4362-a428-3f61fec7273c" (UID: "d1506089-d089-4362-a428-3f61fec7273c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:00.888236 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.888209    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1506089-d089-4362-a428-3f61fec7273c-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.888236 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.888232    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.888236 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.888242    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-557r8\" (UniqueName: \"kubernetes.io/projected/d1506089-d089-4362-a428-3f61fec7273c-kube-api-access-557r8\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.888470 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.888252    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:00.888470 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:00.888260    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1506089-d089-4362-a428-3f61fec7273c-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:01.269626 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.269587    2583 generic.go:356] "Generic (PLEG): container finished" podID="d1506089-d089-4362-a428-3f61fec7273c" containerID="89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c" exitCode=0
Sep 12 03:05:01.269793 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.269648    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"
Sep 12 03:05:01.269793 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.269666    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" event={"ID":"d1506089-d089-4362-a428-3f61fec7273c","Type":"ContainerDied","Data":"89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c"}
Sep 12 03:05:01.269793 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.269734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47" event={"ID":"d1506089-d089-4362-a428-3f61fec7273c","Type":"ContainerDied","Data":"2e9c70e30e1f8971977441cbad582a719bbe76277dea78502efb39e41f987f51"}
Sep 12 03:05:01.269793 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.269763    2583 scope.go:117] "RemoveContainer" containerID="89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c"
Sep 12 03:05:01.279860 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.279841    2583 scope.go:117] "RemoveContainer" containerID="7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"
Sep 12 03:05:01.288264 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.288248    2583 scope.go:117] "RemoveContainer" containerID="89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c"
Sep 12 03:05:01.288657 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:01.288631    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c\": container with ID starting with 89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c not found: ID does not exist" containerID="89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c"
Sep 12 03:05:01.288761 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.288669    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c"} err="failed to get container status \"89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c\": rpc error: code = NotFound desc = could not find container \"89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c\": container with ID starting with 89dd821fed11b064422caf1383e1942fb6e43f385db44c96f3aa0183c659439c not found: ID does not exist"
Sep 12 03:05:01.288761 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.288689    2583 scope.go:117] "RemoveContainer" containerID="7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"
Sep 12 03:05:01.289108 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:01.289077    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0\": container with ID starting with 7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0 not found: ID does not exist" containerID="7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"
Sep 12 03:05:01.289194 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.289117    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0"} err="failed to get container status \"7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0\": rpc error: code = NotFound desc = could not find container \"7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0\": container with ID starting with 7dc79126523718456c2de3f6cac9eecd24dab65e594edf98580a4f4c903c99e0 not found: ID does not exist"
Sep 12 03:05:01.292246 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.292227    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"]
Sep 12 03:05:01.307732 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:01.307702    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-69d2db-openshift-default-566cd8ff98-4pc47"]
Sep 12 03:05:02.162616 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:02.162586    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1506089-d089-4362-a428-3f61fec7273c" path="/var/lib/kubelet/pods/d1506089-d089-4362-a428-3f61fec7273c/volumes"
Sep 12 03:05:11.604498 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.604440    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"]
Sep 12 03:05:11.604910 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.604732    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq" podUID="497e144c-71ae-4352-86e1-40dc56643a15" containerName="payload-processing" containerID="cri-o://5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f" gracePeriod=30
Sep 12 03:05:11.611590 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.610741    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"]
Sep 12 03:05:11.611590 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.610942    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph" podUID="9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" containerName="payload-pre-processing" containerID="cri-o://e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801" gracePeriod=30
Sep 12 03:05:11.762244 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.762207    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"]
Sep 12 03:05:11.765744 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.765714    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-abddb9-xr4p4"]
Sep 12 03:05:11.916433 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.916395    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:05:11.919700 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.919678    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:05:11.998324 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998285    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-plugins-config-volume\") pod \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") "
Sep 12 03:05:11.998505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998371    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r22c7\" (UniqueName: \"kubernetes.io/projected/497e144c-71ae-4352-86e1-40dc56643a15-kube-api-access-r22c7\") pod \"497e144c-71ae-4352-86e1-40dc56643a15\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") "
Sep 12 03:05:11.998505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e144c-71ae-4352-86e1-40dc56643a15-plugins-config-volume\") pod \"497e144c-71ae-4352-86e1-40dc56643a15\" (UID: \"497e144c-71ae-4352-86e1-40dc56643a15\") "
Sep 12 03:05:11.998607 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgfz7\" (UniqueName: \"kubernetes.io/projected/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-kube-api-access-sgfz7\") pod \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\" (UID: \"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5\") "
Sep 12 03:05:11.998800 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/497e144c-71ae-4352-86e1-40dc56643a15-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "497e144c-71ae-4352-86e1-40dc56643a15" (UID: "497e144c-71ae-4352-86e1-40dc56643a15"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:11.998800 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" (UID: "9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:11.998994 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.998971    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:11.999038 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:11.999002    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/497e144c-71ae-4352-86e1-40dc56643a15-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:12.000520 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.000497    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497e144c-71ae-4352-86e1-40dc56643a15-kube-api-access-r22c7" (OuterVolumeSpecName: "kube-api-access-r22c7") pod "497e144c-71ae-4352-86e1-40dc56643a15" (UID: "497e144c-71ae-4352-86e1-40dc56643a15"). InnerVolumeSpecName "kube-api-access-r22c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:12.000606 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.000520    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-kube-api-access-sgfz7" (OuterVolumeSpecName: "kube-api-access-sgfz7") pod "9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" (UID: "9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5"). InnerVolumeSpecName "kube-api-access-sgfz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:12.100573 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.100536    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r22c7\" (UniqueName: \"kubernetes.io/projected/497e144c-71ae-4352-86e1-40dc56643a15-kube-api-access-r22c7\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:12.100573 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.100571    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgfz7\" (UniqueName: \"kubernetes.io/projected/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5-kube-api-access-sgfz7\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:12.161730 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.161672    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07730842-9fa1-4ab0-a83e-4b5b3493c877" path="/var/lib/kubelet/pods/07730842-9fa1-4ab0-a83e-4b5b3493c877/volumes"
Sep 12 03:05:12.345305 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.345269    2583 generic.go:356] "Generic (PLEG): container finished" podID="497e144c-71ae-4352-86e1-40dc56643a15" containerID="5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f" exitCode=0
Sep 12 03:05:12.345505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.345310    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"
Sep 12 03:05:12.345505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.345347    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq" event={"ID":"497e144c-71ae-4352-86e1-40dc56643a15","Type":"ContainerDied","Data":"5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f"}
Sep 12 03:05:12.345505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.345418    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq" event={"ID":"497e144c-71ae-4352-86e1-40dc56643a15","Type":"ContainerDied","Data":"87f508160374f2fea2a10d92015c97599d290d9b0f687bb3ae92601aae0801d3"}
Sep 12 03:05:12.345505 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.345453    2583 scope.go:117] "RemoveContainer" containerID="5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f"
Sep 12 03:05:12.346878 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.346855    2583 generic.go:356] "Generic (PLEG): container finished" podID="9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" containerID="e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801" exitCode=0
Sep 12 03:05:12.346995 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.346890    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"
Sep 12 03:05:12.346995 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.346909    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph" event={"ID":"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5","Type":"ContainerDied","Data":"e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801"}
Sep 12 03:05:12.346995 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.346946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph" event={"ID":"9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5","Type":"ContainerDied","Data":"1998c3bc06936f18e62c0ccdb5b372c87af202463a4c9186fc496b5568506156"}
Sep 12 03:05:12.355259 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.355242    2583 scope.go:117] "RemoveContainer" containerID="5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f"
Sep 12 03:05:12.355639 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:12.355598    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f\": container with ID starting with 5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f not found: ID does not exist" containerID="5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f"
Sep 12 03:05:12.355729 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.355651    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f"} err="failed to get container status \"5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f\": rpc error: code = NotFound desc = could not find container \"5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f\": container with ID starting with 5c50d0a4f1e37eeabdb9523b6e7b73ca152d22a29b889f1c7a8a9f2996a93c8f not found: ID does not exist"
Sep 12 03:05:12.355729 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.355673    2583 scope.go:117] "RemoveContainer" containerID="e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801"
Sep 12 03:05:12.364490 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.364474    2583 scope.go:117] "RemoveContainer" containerID="e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801"
Sep 12 03:05:12.365217 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.364868    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"]
Sep 12 03:05:12.365217 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:12.364932    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801\": container with ID starting with e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801 not found: ID does not exist" containerID="e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801"
Sep 12 03:05:12.365217 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.364982    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801"} err="failed to get container status \"e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801\": rpc error: code = NotFound desc = could not find container \"e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801\": container with ID starting with e94aaebc36f3dc32bb40339e06db242a98449dbab494a96dcdddbd001eada801 not found: ID does not exist"
Sep 12 03:05:12.368425 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.368392    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-abddb9-6cf796f4f8-tnvph"]
Sep 12 03:05:12.379362 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.379344    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"]
Sep 12 03:05:12.385259 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:12.385239    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-abddb9-64fd6bcdb9-7ttzq"]
Sep 12 03:05:14.161791 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:14.161762    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497e144c-71ae-4352-86e1-40dc56643a15" path="/var/lib/kubelet/pods/497e144c-71ae-4352-86e1-40dc56643a15/volumes"
Sep 12 03:05:14.162163 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:14.162115    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" path="/var/lib/kubelet/pods/9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5/volumes"
Sep 12 03:05:18.564255 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.564216    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"]
Sep 12 03:05:18.564955 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.564935    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy"
Sep 12 03:05:18.564999 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.564961    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy"
Sep 12 03:05:18.564999 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.564981    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497e144c-71ae-4352-86e1-40dc56643a15" containerName="payload-processing"
Sep 12 03:05:18.564999 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.564991    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="497e144c-71ae-4352-86e1-40dc56643a15" containerName="payload-processing"
Sep 12 03:05:18.565097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565013    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy"
Sep 12 03:05:18.565097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565022    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy"
Sep 12 03:05:18.565097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565039    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07730842-9fa1-4ab0-a83e-4b5b3493c877" containerName="revoke-keys"
Sep 12 03:05:18.565097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565047    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="07730842-9fa1-4ab0-a83e-4b5b3493c877" containerName="revoke-keys"
Sep 12 03:05:18.565097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565078    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" containerName="payload-pre-processing"
Sep 12 03:05:18.565097 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565086    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" containerName="payload-pre-processing"
Sep 12 03:05:18.565278 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565214    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy"
Sep 12 03:05:18.565278 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565226    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1506089-d089-4362-a428-3f61fec7273c" containerName="istio-proxy"
Sep 12 03:05:18.565278 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565235    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="07730842-9fa1-4ab0-a83e-4b5b3493c877" containerName="revoke-keys"
Sep 12 03:05:18.565278 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565250    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6b5416-2d8c-4f2e-b7ae-e6d6365709a5" containerName="payload-pre-processing"
Sep 12 03:05:18.565278 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.565263    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="497e144c-71ae-4352-86e1-40dc56643a15" containerName="payload-processing"
Sep 12 03:05:18.570743 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.570720    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:18.572728 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.572705    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"]
Sep 12 03:05:18.573241 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.573227    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:05:18.573316 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.573272    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:05:18.662756 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.662722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/250a38a0-d1c7-44fd-810d-ced7f5ff1312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7\" (UID: \"250a38a0-d1c7-44fd-810d-ced7f5ff1312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:18.764617 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.764586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/250a38a0-d1c7-44fd-810d-ced7f5ff1312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7\" (UID: \"250a38a0-d1c7-44fd-810d-ced7f5ff1312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:18.765224 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.765196    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/250a38a0-d1c7-44fd-810d-ced7f5ff1312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7\" (UID: \"250a38a0-d1c7-44fd-810d-ced7f5ff1312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:18.882316 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:18.882226    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:19.159746 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:19.159715    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"]
Sep 12 03:05:19.160382 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:05:19.160361    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod250a38a0_d1c7_44fd_810d_ced7f5ff1312.slice/crio-e527acdfd425abc6e0234e524a456d6465796515349618f1fc41fb587c70d83f WatchSource:0}: Error finding container e527acdfd425abc6e0234e524a456d6465796515349618f1fc41fb587c70d83f: Status 404 returned error can't find the container with id e527acdfd425abc6e0234e524a456d6465796515349618f1fc41fb587c70d83f
Sep 12 03:05:19.396332 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:19.396305    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7" event={"ID":"250a38a0-d1c7-44fd-810d-ced7f5ff1312","Type":"ContainerStarted","Data":"e527acdfd425abc6e0234e524a456d6465796515349618f1fc41fb587c70d83f"}
Sep 12 03:05:20.404944 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:20.404909    2583 generic.go:356] "Generic (PLEG): container finished" podID="250a38a0-d1c7-44fd-810d-ced7f5ff1312" containerID="fa1fdefc7311fbc1f79dd0ef6d70740377ece40edb68d79325d22294a25835d3" exitCode=0
Sep 12 03:05:20.405303 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:20.404987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7" event={"ID":"250a38a0-d1c7-44fd-810d-ced7f5ff1312","Type":"ContainerDied","Data":"fa1fdefc7311fbc1f79dd0ef6d70740377ece40edb68d79325d22294a25835d3"}
Sep 12 03:05:21.557397 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:21.557375    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:21.693008 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:21.692925    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/250a38a0-d1c7-44fd-810d-ced7f5ff1312-maas-api-service-ca\") pod \"250a38a0-d1c7-44fd-810d-ced7f5ff1312\" (UID: \"250a38a0-d1c7-44fd-810d-ced7f5ff1312\") "
Sep 12 03:05:21.693280 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:21.693259    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/250a38a0-d1c7-44fd-810d-ced7f5ff1312-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "250a38a0-d1c7-44fd-810d-ced7f5ff1312" (UID: "250a38a0-d1c7-44fd-810d-ced7f5ff1312"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:21.794454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:21.794401    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/250a38a0-d1c7-44fd-810d-ced7f5ff1312-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:22.423546 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:22.423445    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"
Sep 12 03:05:22.423546 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:22.423470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7" event={"ID":"250a38a0-d1c7-44fd-810d-ced7f5ff1312","Type":"ContainerDied","Data":"e527acdfd425abc6e0234e524a456d6465796515349618f1fc41fb587c70d83f"}
Sep 12 03:05:22.423546 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:22.423519    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e527acdfd425abc6e0234e524a456d6465796515349618f1fc41fb587c70d83f"
Sep 12 03:05:29.135935 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.135901    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"]
Sep 12 03:05:29.138660 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.138639    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-933bba-29819700-jkrl2"]
Sep 12 03:05:29.164392 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.164366    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"]
Sep 12 03:05:29.164838 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.164784    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8" podUID="d87d8b86-0223-4099-b757-5f7443d7573b" containerName="payload-processing" containerID="cri-o://13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a" gracePeriod=30
Sep 12 03:05:29.168733 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.168709    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"]
Sep 12 03:05:29.168930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.168907    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s" podUID="fc4a0fcc-f2b4-4132-9390-908d257861e7" containerName="payload-pre-processing" containerID="cri-o://97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b" gracePeriod=30
Sep 12 03:05:29.315909 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.315866    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"]
Sep 12 03:05:29.319078 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.319044    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-933bba-x5jw7"]
Sep 12 03:05:29.465264 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.465238    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 03:05:29.468107 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.468086    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 03:05:29.475872 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.475849    2583 generic.go:356] "Generic (PLEG): container finished" podID="d87d8b86-0223-4099-b757-5f7443d7573b" containerID="13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a" exitCode=0
Sep 12 03:05:29.475982 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.475894    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"
Sep 12 03:05:29.475982 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.475929    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8" event={"ID":"d87d8b86-0223-4099-b757-5f7443d7573b","Type":"ContainerDied","Data":"13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a"}
Sep 12 03:05:29.476088 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.475982    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8" event={"ID":"d87d8b86-0223-4099-b757-5f7443d7573b","Type":"ContainerDied","Data":"38aa29d13f4f7933641cca10c01b7e2a61dc4f0c886e6eb1722af85e164724a4"}
Sep 12 03:05:29.476088 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.476002    2583 scope.go:117] "RemoveContainer" containerID="13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a"
Sep 12 03:05:29.477302 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.477277    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc4a0fcc-f2b4-4132-9390-908d257861e7" containerID="97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b" exitCode=0
Sep 12 03:05:29.477375 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.477318    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"
Sep 12 03:05:29.477375 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.477318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s" event={"ID":"fc4a0fcc-f2b4-4132-9390-908d257861e7","Type":"ContainerDied","Data":"97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b"}
Sep 12 03:05:29.477375 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.477356    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s" event={"ID":"fc4a0fcc-f2b4-4132-9390-908d257861e7","Type":"ContainerDied","Data":"56e2d7466f52291c8ec6b04a8169027709cc367511dbff885a610c26f4050eb1"}
Sep 12 03:05:29.491641 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.491192    2583 scope.go:117] "RemoveContainer" containerID="13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a"
Sep 12 03:05:29.495429 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:29.492972    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a\": container with ID starting with 13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a not found: ID does not exist" containerID="13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a"
Sep 12 03:05:29.495429 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.493376    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a"} err="failed to get container status \"13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a\": rpc error: code = NotFound desc = could not find container \"13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a\": container with ID starting with 13c685ddb5e849276950b4bf881286672d384029aff2cf78e3e5b0f4d4b49c0a not found: ID does not exist"
Sep 12 03:05:29.495429 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.493429    2583 scope.go:117] "RemoveContainer" containerID="97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b"
Sep 12 03:05:29.520865 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.516536    2583 scope.go:117] "RemoveContainer" containerID="97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b"
Sep 12 03:05:29.520865 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:29.517104    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b\": container with ID starting with 97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b not found: ID does not exist" containerID="97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b"
Sep 12 03:05:29.520865 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.517143    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b"} err="failed to get container status \"97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b\": rpc error: code = NotFound desc = could not find container \"97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b\": container with ID starting with 97117041ecf610a48e919eee9ff5bd7d8f4bd550113dbb59c351009c95086a4b not found: ID does not exist"
Sep 12 03:05:29.571716 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.571666    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4a0fcc-f2b4-4132-9390-908d257861e7-plugins-config-volume\") pod \"fc4a0fcc-f2b4-4132-9390-908d257861e7\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") "
Sep 12 03:05:29.571876 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.571773    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87d8b86-0223-4099-b757-5f7443d7573b-plugins-config-volume\") pod \"d87d8b86-0223-4099-b757-5f7443d7573b\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") "
Sep 12 03:05:29.571914 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.571874    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf5zm\" (UniqueName: \"kubernetes.io/projected/d87d8b86-0223-4099-b757-5f7443d7573b-kube-api-access-qf5zm\") pod \"d87d8b86-0223-4099-b757-5f7443d7573b\" (UID: \"d87d8b86-0223-4099-b757-5f7443d7573b\") "
Sep 12 03:05:29.571914 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.571903    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jk4r\" (UniqueName: \"kubernetes.io/projected/fc4a0fcc-f2b4-4132-9390-908d257861e7-kube-api-access-2jk4r\") pod \"fc4a0fcc-f2b4-4132-9390-908d257861e7\" (UID: \"fc4a0fcc-f2b4-4132-9390-908d257861e7\") "
Sep 12 03:05:29.572098 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.572076    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc4a0fcc-f2b4-4132-9390-908d257861e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc4a0fcc-f2b4-4132-9390-908d257861e7" (UID: "fc4a0fcc-f2b4-4132-9390-908d257861e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:29.572185 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.572115    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d87d8b86-0223-4099-b757-5f7443d7573b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d87d8b86-0223-4099-b757-5f7443d7573b" (UID: "d87d8b86-0223-4099-b757-5f7443d7573b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:29.572319 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.572294    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc4a0fcc-f2b4-4132-9390-908d257861e7-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:29.572319 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.572313    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d87d8b86-0223-4099-b757-5f7443d7573b-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:29.574019 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.573988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d87d8b86-0223-4099-b757-5f7443d7573b-kube-api-access-qf5zm" (OuterVolumeSpecName: "kube-api-access-qf5zm") pod "d87d8b86-0223-4099-b757-5f7443d7573b" (UID: "d87d8b86-0223-4099-b757-5f7443d7573b"). InnerVolumeSpecName "kube-api-access-qf5zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:29.574114 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.574067    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4a0fcc-f2b4-4132-9390-908d257861e7-kube-api-access-2jk4r" (OuterVolumeSpecName: "kube-api-access-2jk4r") pod "fc4a0fcc-f2b4-4132-9390-908d257861e7" (UID: "fc4a0fcc-f2b4-4132-9390-908d257861e7"). InnerVolumeSpecName "kube-api-access-2jk4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:29.673865 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.673829    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf5zm\" (UniqueName: \"kubernetes.io/projected/d87d8b86-0223-4099-b757-5f7443d7573b-kube-api-access-qf5zm\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:29.673865 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.673863    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jk4r\" (UniqueName: \"kubernetes.io/projected/fc4a0fcc-f2b4-4132-9390-908d257861e7-kube-api-access-2jk4r\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:29.804812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.804768    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"]
Sep 12 03:05:29.807980 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.807958    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-933bba-f8869b9f8-9wl5s"]
Sep 12 03:05:29.815520 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.815495    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"]
Sep 12 03:05:29.817963 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:29.817944    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-933bba-5758cbf77-rkmk8"]
Sep 12 03:05:30.162226 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:30.162191    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="250a38a0-d1c7-44fd-810d-ced7f5ff1312" path="/var/lib/kubelet/pods/250a38a0-d1c7-44fd-810d-ced7f5ff1312/volumes"
Sep 12 03:05:30.162601 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:30.162526    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ce2542-1851-43c9-828f-a77ddde4bf4e" path="/var/lib/kubelet/pods/a4ce2542-1851-43c9-828f-a77ddde4bf4e/volumes"
Sep 12 03:05:30.162841 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:30.162811    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d87d8b86-0223-4099-b757-5f7443d7573b" path="/var/lib/kubelet/pods/d87d8b86-0223-4099-b757-5f7443d7573b/volumes"
Sep 12 03:05:30.163269 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:30.163249    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc4a0fcc-f2b4-4132-9390-908d257861e7" path="/var/lib/kubelet/pods/fc4a0fcc-f2b4-4132-9390-908d257861e7/volumes"
Sep 12 03:05:35.967297 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:35.967266    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"]
Sep 12 03:05:35.968004 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:35.967955    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy" containerID="cri-o://d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11" gracePeriod=30
Sep 12 03:05:36.336224 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336183    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"]
Sep 12 03:05:36.336731 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336713    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="250a38a0-d1c7-44fd-810d-ced7f5ff1312" containerName="revoke-keys"
Sep 12 03:05:36.336848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336732    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="250a38a0-d1c7-44fd-810d-ced7f5ff1312" containerName="revoke-keys"
Sep 12 03:05:36.336848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336749    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc4a0fcc-f2b4-4132-9390-908d257861e7" containerName="payload-pre-processing"
Sep 12 03:05:36.336848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336756    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc4a0fcc-f2b4-4132-9390-908d257861e7" containerName="payload-pre-processing"
Sep 12 03:05:36.336848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336828    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d87d8b86-0223-4099-b757-5f7443d7573b" containerName="payload-processing"
Sep 12 03:05:36.336848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336837    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d87d8b86-0223-4099-b757-5f7443d7573b" containerName="payload-processing"
Sep 12 03:05:36.337091 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336947    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc4a0fcc-f2b4-4132-9390-908d257861e7" containerName="payload-pre-processing"
Sep 12 03:05:36.337091 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336965    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d87d8b86-0223-4099-b757-5f7443d7573b" containerName="payload-processing"
Sep 12 03:05:36.337091 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.336974    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="250a38a0-d1c7-44fd-810d-ced7f5ff1312" containerName="revoke-keys"
Sep 12 03:05:36.341894 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.341874    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:36.344338 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.344313    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:05:36.344479 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.344313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:05:36.347330 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.347307    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"]
Sep 12 03:05:36.431581 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.431548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/127731f4-c80f-4cf3-b95c-97f0c5fbde4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z\" (UID: \"127731f4-c80f-4cf3-b95c-97f0c5fbde4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:36.532519 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.532489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/127731f4-c80f-4cf3-b95c-97f0c5fbde4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z\" (UID: \"127731f4-c80f-4cf3-b95c-97f0c5fbde4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:36.533058 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.533040    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/127731f4-c80f-4cf3-b95c-97f0c5fbde4a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z\" (UID: \"127731f4-c80f-4cf3-b95c-97f0c5fbde4a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:36.653957 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.653867    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:36.923788 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:36.923761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"]
Sep 12 03:05:36.925154 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:05:36.925129    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127731f4_c80f_4cf3_b95c_97f0c5fbde4a.slice/crio-8a8e624eb074a0b7d64595e6ba2996fac9f3b1579d60ef884136d42a37bec357 WatchSource:0}: Error finding container 8a8e624eb074a0b7d64595e6ba2996fac9f3b1579d60ef884136d42a37bec357: Status 404 returned error can't find the container with id 8a8e624eb074a0b7d64595e6ba2996fac9f3b1579d60ef884136d42a37bec357
Sep 12 03:05:37.540254 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:37.540229    2583 generic.go:356] "Generic (PLEG): container finished" podID="127731f4-c80f-4cf3-b95c-97f0c5fbde4a" containerID="e51090beecc094f7989c194d85b2705e7ba5adc1675191155f59f4ba81a42ac6" exitCode=0
Sep 12 03:05:37.540743 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:37.540265    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z" event={"ID":"127731f4-c80f-4cf3-b95c-97f0c5fbde4a","Type":"ContainerDied","Data":"e51090beecc094f7989c194d85b2705e7ba5adc1675191155f59f4ba81a42ac6"}
Sep 12 03:05:37.540743 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:37.540300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z" event={"ID":"127731f4-c80f-4cf3-b95c-97f0c5fbde4a","Type":"ContainerStarted","Data":"8a8e624eb074a0b7d64595e6ba2996fac9f3b1579d60ef884136d42a37bec357"}
Sep 12 03:05:38.692172 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:38.692149    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:38.755470 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:38.755447    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/127731f4-c80f-4cf3-b95c-97f0c5fbde4a-maas-api-service-ca\") pod \"127731f4-c80f-4cf3-b95c-97f0c5fbde4a\" (UID: \"127731f4-c80f-4cf3-b95c-97f0c5fbde4a\") "
Sep 12 03:05:38.755798 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:38.755775    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/127731f4-c80f-4cf3-b95c-97f0c5fbde4a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "127731f4-c80f-4cf3-b95c-97f0c5fbde4a" (UID: "127731f4-c80f-4cf3-b95c-97f0c5fbde4a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:38.856380 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:38.856348    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/127731f4-c80f-4cf3-b95c-97f0c5fbde4a-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:39.557813 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:39.557777    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"
Sep 12 03:05:39.557993 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:39.557809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z" event={"ID":"127731f4-c80f-4cf3-b95c-97f0c5fbde4a","Type":"ContainerDied","Data":"8a8e624eb074a0b7d64595e6ba2996fac9f3b1579d60ef884136d42a37bec357"}
Sep 12 03:05:39.557993 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:39.557865    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a8e624eb074a0b7d64595e6ba2996fac9f3b1579d60ef884136d42a37bec357"
Sep 12 03:05:41.240473 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.240393    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 03:05:41.279967 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.279940    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-podinfo\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280116 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.279976    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-credential-socket\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280116 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280017    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-data\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280213 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280184    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-socket\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280273 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280231    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-certs\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280273 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280255    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:41.280273 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kk8d\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-kube-api-access-2kk8d\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280435 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280309    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-token\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280435 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280329    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:41.280549 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280396    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:41.280549 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280464    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:41.280549 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280484    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istiod-ca-cert\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280549 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280524    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-envoy\") pod \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\" (UID: \"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d\") "
Sep 12 03:05:41.280822 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280801    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:41.280926 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280909    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.280981 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280929    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.280981 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280943    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.280981 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280952    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.280981 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.280960    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.282703 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.282673    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:05:41.282808 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.282678    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-kube-api-access-2kk8d" (OuterVolumeSpecName: "kube-api-access-2kk8d") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "kube-api-access-2kk8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:41.282808 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.282764    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:05:41.282808 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.282781    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" (UID: "a9fd59fe-6e89-41cd-98a2-43fa1aadd48d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:41.381744 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.381696    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.381744 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.381739    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kk8d\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-kube-api-access-2kk8d\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.381914 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.381755    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.381914 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.381767    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:41.573309 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.573276    2583 generic.go:356] "Generic (PLEG): container finished" podID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerID="d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11" exitCode=0
Sep 12 03:05:41.573508 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.573319    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" event={"ID":"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d","Type":"ContainerDied","Data":"d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11"}
Sep 12 03:05:41.573508 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.573328    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"
Sep 12 03:05:41.573508 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.573374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4" event={"ID":"a9fd59fe-6e89-41cd-98a2-43fa1aadd48d","Type":"ContainerDied","Data":"4dd99f551e646ed161bedc7691317423334636aea44992e2dce19e3ee9c1a84e"}
Sep 12 03:05:41.573508 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.573432    2583 scope.go:117] "RemoveContainer" containerID="d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11"
Sep 12 03:05:41.583943 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.583924    2583 scope.go:117] "RemoveContainer" containerID="1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"
Sep 12 03:05:41.592891 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.592877    2583 scope.go:117] "RemoveContainer" containerID="d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11"
Sep 12 03:05:41.593187 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:41.593161    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11\": container with ID starting with d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11 not found: ID does not exist" containerID="d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11"
Sep 12 03:05:41.593290 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.593194    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11"} err="failed to get container status \"d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11\": rpc error: code = NotFound desc = could not find container \"d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11\": container with ID starting with d5d2f0119710e6db40b117ae43d110d0e5497be236ceb8ef6fe155e4b07f2d11 not found: ID does not exist"
Sep 12 03:05:41.593290 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.593217    2583 scope.go:117] "RemoveContainer" containerID="1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"
Sep 12 03:05:41.593553 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:41.593536    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049\": container with ID starting with 1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049 not found: ID does not exist" containerID="1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"
Sep 12 03:05:41.593623 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.593560    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049"} err="failed to get container status \"1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049\": rpc error: code = NotFound desc = could not find container \"1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049\": container with ID starting with 1aa07126df40ee4275fa4f8b1a02bd4461d6359117b0225bfd56146729fd1049 not found: ID does not exist"
Sep 12 03:05:41.596212 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.596191    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"]
Sep 12 03:05:41.600623 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:41.600602    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-933bba-openshift-default-d47b7d4b-6xrw4"]
Sep 12 03:05:42.161335 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:42.161303    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" path="/var/lib/kubelet/pods/a9fd59fe-6e89-41cd-98a2-43fa1aadd48d/volumes"
Sep 12 03:05:46.877339 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:46.877304    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"]
Sep 12 03:05:46.880080 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:46.880058    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-d2effd-29819700-wb5nl"]
Sep 12 03:05:46.905650 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:46.905623    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"]
Sep 12 03:05:46.905922 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:46.905871    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5" podUID="6a29f3dd-04dc-4363-9628-c20288cdb4c8" containerName="payload-processing" containerID="cri-o://0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d" gracePeriod=30
Sep 12 03:05:46.932581 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:46.931619    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"]
Sep 12 03:05:46.932581 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:46.931944    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk" podUID="d4ada027-f3f5-499d-ae3c-144cd9bec909" containerName="payload-pre-processing" containerID="cri-o://6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6" gracePeriod=30
Sep 12 03:05:47.087020 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.086983    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"]
Sep 12 03:05:47.089780 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.089749    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d2effd-xp76z"]
Sep 12 03:05:47.212356 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.212282    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 03:05:47.215657 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.215637    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 03:05:47.340427 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.340373    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkrtq\" (UniqueName: \"kubernetes.io/projected/d4ada027-f3f5-499d-ae3c-144cd9bec909-kube-api-access-nkrtq\") pod \"d4ada027-f3f5-499d-ae3c-144cd9bec909\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") "
Sep 12 03:05:47.340590 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.340533    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada027-f3f5-499d-ae3c-144cd9bec909-plugins-config-volume\") pod \"d4ada027-f3f5-499d-ae3c-144cd9bec909\" (UID: \"d4ada027-f3f5-499d-ae3c-144cd9bec909\") "
Sep 12 03:05:47.340590 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.340556    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2nbg\" (UniqueName: \"kubernetes.io/projected/6a29f3dd-04dc-4363-9628-c20288cdb4c8-kube-api-access-x2nbg\") pod \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") "
Sep 12 03:05:47.340590 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.340573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a29f3dd-04dc-4363-9628-c20288cdb4c8-plugins-config-volume\") pod \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\" (UID: \"6a29f3dd-04dc-4363-9628-c20288cdb4c8\") "
Sep 12 03:05:47.340944 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.340916    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4ada027-f3f5-499d-ae3c-144cd9bec909-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4ada027-f3f5-499d-ae3c-144cd9bec909" (UID: "d4ada027-f3f5-499d-ae3c-144cd9bec909"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:47.341047 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.340994    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a29f3dd-04dc-4363-9628-c20288cdb4c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6a29f3dd-04dc-4363-9628-c20288cdb4c8" (UID: "6a29f3dd-04dc-4363-9628-c20288cdb4c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:47.342625 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.342599    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4ada027-f3f5-499d-ae3c-144cd9bec909-kube-api-access-nkrtq" (OuterVolumeSpecName: "kube-api-access-nkrtq") pod "d4ada027-f3f5-499d-ae3c-144cd9bec909" (UID: "d4ada027-f3f5-499d-ae3c-144cd9bec909"). InnerVolumeSpecName "kube-api-access-nkrtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:47.342746 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.342679    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a29f3dd-04dc-4363-9628-c20288cdb4c8-kube-api-access-x2nbg" (OuterVolumeSpecName: "kube-api-access-x2nbg") pod "6a29f3dd-04dc-4363-9628-c20288cdb4c8" (UID: "6a29f3dd-04dc-4363-9628-c20288cdb4c8"). InnerVolumeSpecName "kube-api-access-x2nbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:05:47.442209 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.442147    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4ada027-f3f5-499d-ae3c-144cd9bec909-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:47.442209 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.442171    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2nbg\" (UniqueName: \"kubernetes.io/projected/6a29f3dd-04dc-4363-9628-c20288cdb4c8-kube-api-access-x2nbg\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:47.442209 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.442180    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a29f3dd-04dc-4363-9628-c20288cdb4c8-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:47.442209 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.442189    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkrtq\" (UniqueName: \"kubernetes.io/projected/d4ada027-f3f5-499d-ae3c-144cd9bec909-kube-api-access-nkrtq\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:47.615826 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.615792    2583 generic.go:356] "Generic (PLEG): container finished" podID="d4ada027-f3f5-499d-ae3c-144cd9bec909" containerID="6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6" exitCode=0
Sep 12 03:05:47.615992 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.615840    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"
Sep 12 03:05:47.615992 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.615839    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk" event={"ID":"d4ada027-f3f5-499d-ae3c-144cd9bec909","Type":"ContainerDied","Data":"6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6"}
Sep 12 03:05:47.615992 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.615897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk" event={"ID":"d4ada027-f3f5-499d-ae3c-144cd9bec909","Type":"ContainerDied","Data":"c59ae3b1f5e5ae90b129d6c0ec06bd908ad4c306a970abdb882a70b8a937abb6"}
Sep 12 03:05:47.615992 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.615927    2583 scope.go:117] "RemoveContainer" containerID="6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6"
Sep 12 03:05:47.617430 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.617381    2583 generic.go:356] "Generic (PLEG): container finished" podID="6a29f3dd-04dc-4363-9628-c20288cdb4c8" containerID="0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d" exitCode=0
Sep 12 03:05:47.617556 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.617442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5" event={"ID":"6a29f3dd-04dc-4363-9628-c20288cdb4c8","Type":"ContainerDied","Data":"0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d"}
Sep 12 03:05:47.617628 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.617593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5" event={"ID":"6a29f3dd-04dc-4363-9628-c20288cdb4c8","Type":"ContainerDied","Data":"60d6281d9cffa69b559820e59e547277d73363ca5c7d28473a2cfa772c0b3525"}
Sep 12 03:05:47.617628 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.617451    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"
Sep 12 03:05:47.633199 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.633181    2583 scope.go:117] "RemoveContainer" containerID="6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6"
Sep 12 03:05:47.633546 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:47.633526    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6\": container with ID starting with 6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6 not found: ID does not exist" containerID="6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6"
Sep 12 03:05:47.633617 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.633555    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6"} err="failed to get container status \"6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6\": rpc error: code = NotFound desc = could not find container \"6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6\": container with ID starting with 6172a2e0e263a0b01a9adfdcf20363a82b56b55ca78abc7181984d23187ae9b6 not found: ID does not exist"
Sep 12 03:05:47.633617 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.633573    2583 scope.go:117] "RemoveContainer" containerID="0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d"
Sep 12 03:05:47.642343 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.642327    2583 scope.go:117] "RemoveContainer" containerID="0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d"
Sep 12 03:05:47.642672 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:05:47.642653    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d\": container with ID starting with 0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d not found: ID does not exist" containerID="0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d"
Sep 12 03:05:47.642753 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.642682    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d"} err="failed to get container status \"0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d\": rpc error: code = NotFound desc = could not find container \"0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d\": container with ID starting with 0b358bfe4ec053d3ab447d1ddbe24b07f2bfd33f56cdfa84ac1fb88eb8f3aa1d not found: ID does not exist"
Sep 12 03:05:47.646252 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.646227    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"]
Sep 12 03:05:47.651334 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.651308    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d2effd-5cd7947986-b66gk"]
Sep 12 03:05:47.661377 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.661355    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"]
Sep 12 03:05:47.665962 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:47.665940    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-d2effd-844bf9b5bf-wd9g5"]
Sep 12 03:05:48.162833 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:48.162803    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127731f4-c80f-4cf3-b95c-97f0c5fbde4a" path="/var/lib/kubelet/pods/127731f4-c80f-4cf3-b95c-97f0c5fbde4a/volumes"
Sep 12 03:05:48.163189 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:48.163076    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3153ac7e-7fcc-44d2-870d-e0b5d5f43f12" path="/var/lib/kubelet/pods/3153ac7e-7fcc-44d2-870d-e0b5d5f43f12/volumes"
Sep 12 03:05:48.163365 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:48.163353    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a29f3dd-04dc-4363-9628-c20288cdb4c8" path="/var/lib/kubelet/pods/6a29f3dd-04dc-4363-9628-c20288cdb4c8/volumes"
Sep 12 03:05:48.163730 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:48.163717    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4ada027-f3f5-499d-ae3c-144cd9bec909" path="/var/lib/kubelet/pods/d4ada027-f3f5-499d-ae3c-144cd9bec909/volumes"
Sep 12 03:05:49.726514 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.726482    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"]
Sep 12 03:05:49.727106 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727086    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727110    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727121    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4ada027-f3f5-499d-ae3c-144cd9bec909" containerName="payload-pre-processing"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727129    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4ada027-f3f5-499d-ae3c-144cd9bec909" containerName="payload-pre-processing"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727144    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127731f4-c80f-4cf3-b95c-97f0c5fbde4a" containerName="revoke-keys"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727154    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="127731f4-c80f-4cf3-b95c-97f0c5fbde4a" containerName="revoke-keys"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727167    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a29f3dd-04dc-4363-9628-c20288cdb4c8" containerName="payload-processing"
Sep 12 03:05:49.727196 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727175    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a29f3dd-04dc-4363-9628-c20288cdb4c8" containerName="payload-processing"
Sep 12 03:05:49.727593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727295    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="127731f4-c80f-4cf3-b95c-97f0c5fbde4a" containerName="revoke-keys"
Sep 12 03:05:49.727593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727307    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy"
Sep 12 03:05:49.727593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727317    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a29f3dd-04dc-4363-9628-c20288cdb4c8" containerName="payload-processing"
Sep 12 03:05:49.727593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727330    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy"
Sep 12 03:05:49.727593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.727339    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4ada027-f3f5-499d-ae3c-144cd9bec909" containerName="payload-pre-processing"
Sep 12 03:05:49.732050 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.732031    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:49.734660 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.734638    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:05:49.734772 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.734641    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:05:49.736572 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.736552    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"]
Sep 12 03:05:49.864471 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.864440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr\" (UID: \"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:49.965249 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.965218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr\" (UID: \"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:49.965804 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:49.965787    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr\" (UID: \"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:50.044964 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:50.044899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:50.320564 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:50.320537    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"]
Sep 12 03:05:50.321610 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:05:50.321579    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcff2abf4_1a5c_4ee2_b724_d6c0283e6f54.slice/crio-147d667dbff3d6bd1a1d1782ea7f653935d3fe6f7164c6ae04d9acdc1869d234 WatchSource:0}: Error finding container 147d667dbff3d6bd1a1d1782ea7f653935d3fe6f7164c6ae04d9acdc1869d234: Status 404 returned error can't find the container with id 147d667dbff3d6bd1a1d1782ea7f653935d3fe6f7164c6ae04d9acdc1869d234
Sep 12 03:05:50.640459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:50.640426    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr" event={"ID":"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54","Type":"ContainerStarted","Data":"4f4092d6bac84b94e29ef2a0683c74e7e681b68d2547129566772ebaf0b045c2"}
Sep 12 03:05:50.640570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:50.640503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr" event={"ID":"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54","Type":"ContainerStarted","Data":"147d667dbff3d6bd1a1d1782ea7f653935d3fe6f7164c6ae04d9acdc1869d234"}
Sep 12 03:05:50.655110 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:50.655066    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr" podStartSLOduration=1.655051989 podStartE2EDuration="1.655051989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:05:50.654700175 +0000 UTC m=+1782.910681182" watchObservedRunningTime="2026-09-12 03:05:50.655051989 +0000 UTC m=+1782.911033004"
Sep 12 03:05:51.649636 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:51.649602    2583 generic.go:356] "Generic (PLEG): container finished" podID="cff2abf4-1a5c-4ee2-b724-d6c0283e6f54" containerID="4f4092d6bac84b94e29ef2a0683c74e7e681b68d2547129566772ebaf0b045c2" exitCode=0
Sep 12 03:05:51.650020 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:51.649644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr" event={"ID":"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54","Type":"ContainerDied","Data":"4f4092d6bac84b94e29ef2a0683c74e7e681b68d2547129566772ebaf0b045c2"}
Sep 12 03:05:52.791806 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:52.791779    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:52.892906 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:52.892880    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54-maas-api-service-ca\") pod \"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54\" (UID: \"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54\") "
Sep 12 03:05:52.893202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:52.893180    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cff2abf4-1a5c-4ee2-b724-d6c0283e6f54" (UID: "cff2abf4-1a5c-4ee2-b724-d6c0283e6f54"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:05:52.994073 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:52.994014    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:05:53.664147 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:53.664114    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"
Sep 12 03:05:53.664317 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:53.664169    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr" event={"ID":"cff2abf4-1a5c-4ee2-b724-d6c0283e6f54","Type":"ContainerDied","Data":"147d667dbff3d6bd1a1d1782ea7f653935d3fe6f7164c6ae04d9acdc1869d234"}
Sep 12 03:05:53.664317 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:05:53.664213    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="147d667dbff3d6bd1a1d1782ea7f653935d3fe6f7164c6ae04d9acdc1869d234"
Sep 12 03:06:05.617747 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.617668    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"]
Sep 12 03:06:05.620176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.620152    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-c6190b-29819700-9tns6"]
Sep 12 03:06:05.651913 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.651877    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"]
Sep 12 03:06:05.652134 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.652109    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl" podUID="d7c99fe2-68db-4fed-a596-737cc216e16d" containerName="payload-pre-processing" containerID="cri-o://479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30" gracePeriod=30
Sep 12 03:06:05.802735 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.802703    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"]
Sep 12 03:06:05.807159 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.807133    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-c6190b-k8gdr"]
Sep 12 03:06:05.907099 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:05.907076    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 03:06:06.020906 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.020875    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdjwz\" (UniqueName: \"kubernetes.io/projected/d7c99fe2-68db-4fed-a596-737cc216e16d-kube-api-access-zdjwz\") pod \"d7c99fe2-68db-4fed-a596-737cc216e16d\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") "
Sep 12 03:06:06.021101 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.020982    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7c99fe2-68db-4fed-a596-737cc216e16d-plugins-config-volume\") pod \"d7c99fe2-68db-4fed-a596-737cc216e16d\" (UID: \"d7c99fe2-68db-4fed-a596-737cc216e16d\") "
Sep 12 03:06:06.021346 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.021320    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c99fe2-68db-4fed-a596-737cc216e16d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d7c99fe2-68db-4fed-a596-737cc216e16d" (UID: "d7c99fe2-68db-4fed-a596-737cc216e16d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:06:06.023025 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.023004    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c99fe2-68db-4fed-a596-737cc216e16d-kube-api-access-zdjwz" (OuterVolumeSpecName: "kube-api-access-zdjwz") pod "d7c99fe2-68db-4fed-a596-737cc216e16d" (UID: "d7c99fe2-68db-4fed-a596-737cc216e16d"). InnerVolumeSpecName "kube-api-access-zdjwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:06:06.124163 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.124119    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d7c99fe2-68db-4fed-a596-737cc216e16d-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:06.124163 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.124159    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdjwz\" (UniqueName: \"kubernetes.io/projected/d7c99fe2-68db-4fed-a596-737cc216e16d-kube-api-access-zdjwz\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:06.162518 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.162430    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cff2abf4-1a5c-4ee2-b724-d6c0283e6f54" path="/var/lib/kubelet/pods/cff2abf4-1a5c-4ee2-b724-d6c0283e6f54/volumes"
Sep 12 03:06:06.162810 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.162788    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daa9db66-b494-4a88-99da-e48ee5f56e7e" path="/var/lib/kubelet/pods/daa9db66-b494-4a88-99da-e48ee5f56e7e/volumes"
Sep 12 03:06:06.751215 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.751177    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7c99fe2-68db-4fed-a596-737cc216e16d" containerID="479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30" exitCode=0
Sep 12 03:06:06.751651 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.751232    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"
Sep 12 03:06:06.751651 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.751267    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl" event={"ID":"d7c99fe2-68db-4fed-a596-737cc216e16d","Type":"ContainerDied","Data":"479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30"}
Sep 12 03:06:06.751651 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.751320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl" event={"ID":"d7c99fe2-68db-4fed-a596-737cc216e16d","Type":"ContainerDied","Data":"36248c9ee030166e5b1aba08ff3ff0358d4d0426f8d24403f959992303380d6b"}
Sep 12 03:06:06.751651 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.751347    2583 scope.go:117] "RemoveContainer" containerID="479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30"
Sep 12 03:06:06.761075 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.761058    2583 scope.go:117] "RemoveContainer" containerID="479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30"
Sep 12 03:06:06.761306 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:06:06.761280    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30\": container with ID starting with 479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30 not found: ID does not exist" containerID="479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30"
Sep 12 03:06:06.761431 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.761308    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30"} err="failed to get container status \"479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30\": rpc error: code = NotFound desc = could not find container \"479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30\": container with ID starting with 479e5f1927bd076b772fb124fb3c13454373278b644bed8e0ed0d8704db04d30 not found: ID does not exist"
Sep 12 03:06:06.767527 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.767503    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"]
Sep 12 03:06:06.771219 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:06.771199    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-c6190b-bbdf76f46-lxwzl"]
Sep 12 03:06:08.161826 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.161795    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c99fe2-68db-4fed-a596-737cc216e16d" path="/var/lib/kubelet/pods/d7c99fe2-68db-4fed-a596-737cc216e16d/volumes"
Sep 12 03:06:08.581030 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.581001    2583 scope.go:117] "RemoveContainer" containerID="acbd9a58aec83702d9f552edfe1a08572afadfa426125fb535e1a0e7208c0135"
Sep 12 03:06:08.592791 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.590641    2583 scope.go:117] "RemoveContainer" containerID="cdd4e79d5c54b8ae3bb5ffc78f4f041cc639365b582952fb77964f683d7f9af3"
Sep 12 03:06:08.601176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.601159    2583 scope.go:117] "RemoveContainer" containerID="f8f77a778859798617988cb0269268fc56a51bef08a6bac4dd366b81f2394e7e"
Sep 12 03:06:08.609054 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.609036    2583 scope.go:117] "RemoveContainer" containerID="5fdd35cd3a6cf1676714b68d77a1d287dc54a42ef54ffe6f63fa071a78f9a393"
Sep 12 03:06:08.616622 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.616605    2583 scope.go:117] "RemoveContainer" containerID="5b482626cf0c6aaf020d0c86f4554d41f17946452aea6b474fd9445d83f9c53d"
Sep 12 03:06:08.624227 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.624200    2583 scope.go:117] "RemoveContainer" containerID="f1d2771aaa5950fc85d4fcc4a3fd418777fee43db2b992c672e6b229cd7c47e1"
Sep 12 03:06:08.724683 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.724662    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:06:08.728025 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.728008    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:06:08.729848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.729832    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:06:08.733040 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:08.733024    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:06:12.619951 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:12.619920    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"]
Sep 12 03:06:12.620357 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:12.620145    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy" containerID="cri-o://8de511a151daf351ee55146d1b96b713431d41c82d156af409d0617eaf130bcf" gracePeriod=30
Sep 12 03:06:17.826609 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.826573    2583 generic.go:356] "Generic (PLEG): container finished" podID="7060a897-6828-4452-8ada-ae311777df0a" containerID="8de511a151daf351ee55146d1b96b713431d41c82d156af409d0617eaf130bcf" exitCode=0
Sep 12 03:06:17.827038 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.826612    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" event={"ID":"7060a897-6828-4452-8ada-ae311777df0a","Type":"ContainerDied","Data":"8de511a151daf351ee55146d1b96b713431d41c82d156af409d0617eaf130bcf"}
Sep 12 03:06:17.827038 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.826675    2583 scope.go:117] "RemoveContainer" containerID="b79ab846eec749a58f0ed87e0113c37211ff970cd9a7cd69eaffbbcf56edac21"
Sep 12 03:06:17.872454 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.872433    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 03:06:17.934365 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934298    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kp8f\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-kube-api-access-9kp8f\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934365 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934333    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-istio-token\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934365 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7060a897-6828-4452-8ada-ae311777df0a-istiod-ca-cert\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934401    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-socket\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-credential-socket\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934483    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-data\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934506    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-envoy\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934567    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-certs\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934598    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7060a897-6828-4452-8ada-ae311777df0a-istio-podinfo\") pod \"7060a897-6828-4452-8ada-ae311777df0a\" (UID: \"7060a897-6828-4452-8ada-ae311777df0a\") "
Sep 12 03:06:17.934965 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934741    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:06:17.934965 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934748    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:06:17.934965 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934786    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-data" (OuterVolumeSpecName: "istio-data") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:06:17.934965 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934820    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7060a897-6828-4452-8ada-ae311777df0a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:06:17.935176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.934965    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:06:17.935176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.935020    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7060a897-6828-4452-8ada-ae311777df0a-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:17.935176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.935042    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:17.935176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.935056    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:17.935176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.935070    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:17.936521 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.936500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-kube-api-access-9kp8f" (OuterVolumeSpecName: "kube-api-access-9kp8f") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "kube-api-access-9kp8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:06:17.936630 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.936519    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-istio-token" (OuterVolumeSpecName: "istio-token") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:06:17.936718 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.936703    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:06:17.936798 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:17.936784    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7060a897-6828-4452-8ada-ae311777df0a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7060a897-6828-4452-8ada-ae311777df0a" (UID: "7060a897-6828-4452-8ada-ae311777df0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:06:18.035626 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.035584    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:18.035626 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.035620    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7060a897-6828-4452-8ada-ae311777df0a-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:18.035626 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.035629    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7060a897-6828-4452-8ada-ae311777df0a-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:18.035626 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.035637    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kp8f\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-kube-api-access-9kp8f\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:18.035887 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.035646    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7060a897-6828-4452-8ada-ae311777df0a-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:06:18.833733 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.833706    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"
Sep 12 03:06:18.834202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.833732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87" event={"ID":"7060a897-6828-4452-8ada-ae311777df0a","Type":"ContainerDied","Data":"8cc3044525f3dcd3fd2f2a823ca46199e785fae132abf618d157aaf66bb243a3"}
Sep 12 03:06:18.834202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.833787    2583 scope.go:117] "RemoveContainer" containerID="8de511a151daf351ee55146d1b96b713431d41c82d156af409d0617eaf130bcf"
Sep 12 03:06:18.852223 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.852198    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"]
Sep 12 03:06:18.855230 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:18.855209    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-c6190b-openshift-default-7f858d6694-fvx87"]
Sep 12 03:06:20.161548 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:06:20.161519    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7060a897-6828-4452-8ada-ae311777df0a" path="/var/lib/kubelet/pods/7060a897-6828-4452-8ada-ae311777df0a/volumes"
Sep 12 03:07:08.704999 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:07:08.704967    2583 scope.go:117] "RemoveContainer" containerID="c88e78709f89a4b9eaae717a01792b6425aa179d0ce1e2b46c9f35f020e409d0"
Sep 12 03:08:08.735648 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:08:08.735560    2583 scope.go:117] "RemoveContainer" containerID="fc4a377aca3dea307e888966000c510de1e2e02c2037cd616da3bdaafb46fcee"
Sep 12 03:09:32.539532 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539501    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"]
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539895    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539907    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539921    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cff2abf4-1a5c-4ee2-b724-d6c0283e6f54" containerName="revoke-keys"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539926    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cff2abf4-1a5c-4ee2-b724-d6c0283e6f54" containerName="revoke-keys"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539946    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c99fe2-68db-4fed-a596-737cc216e16d" containerName="payload-pre-processing"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539952    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c99fe2-68db-4fed-a596-737cc216e16d" containerName="payload-pre-processing"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539965    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy"
Sep 12 03:09:32.539978 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.539970    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fd59fe-6e89-41cd-98a2-43fa1aadd48d" containerName="istio-proxy"
Sep 12 03:09:32.540238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.540033    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy"
Sep 12 03:09:32.540238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.540040    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cff2abf4-1a5c-4ee2-b724-d6c0283e6f54" containerName="revoke-keys"
Sep 12 03:09:32.540238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.540051    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c99fe2-68db-4fed-a596-737cc216e16d" containerName="payload-pre-processing"
Sep 12 03:09:32.543233 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.543219    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.546136 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.546110    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-ad5a1b\""
Sep 12 03:09:32.546265 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.546117    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-ad5a1b-dockercfg-wxfpg\""
Sep 12 03:09:32.553540 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.553518    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"]
Sep 12 03:09:32.559262 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.559244    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"]
Sep 12 03:09:32.559659 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.559646    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy"
Sep 12 03:09:32.559712 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.559661    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy"
Sep 12 03:09:32.559749 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.559730    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7060a897-6828-4452-8ada-ae311777df0a" containerName="istio-proxy"
Sep 12 03:09:32.562874 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.562853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.573391 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.573368    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"]
Sep 12 03:09:32.658358 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.658324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xmd4\" (UniqueName: \"kubernetes.io/projected/d49390f6-ceec-42b8-a2be-38f5396c75ef-kube-api-access-4xmd4\") pod \"payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.658556 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.658375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d49390f6-ceec-42b8-a2be-38f5396c75ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.658556 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.658484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/022efc78-809a-4b2c-b9f9-3a915de15fe4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.658690 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.658646    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgp7\" (UniqueName: \"kubernetes.io/projected/022efc78-809a-4b2c-b9f9-3a915de15fe4-kube-api-access-2sgp7\") pod \"payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.759386 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.759356    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgp7\" (UniqueName: \"kubernetes.io/projected/022efc78-809a-4b2c-b9f9-3a915de15fe4-kube-api-access-2sgp7\") pod \"payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.759612 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.759465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xmd4\" (UniqueName: \"kubernetes.io/projected/d49390f6-ceec-42b8-a2be-38f5396c75ef-kube-api-access-4xmd4\") pod \"payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.759612 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.759505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d49390f6-ceec-42b8-a2be-38f5396c75ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.759612 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.759545    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/022efc78-809a-4b2c-b9f9-3a915de15fe4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.760220 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.760202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d49390f6-ceec-42b8-a2be-38f5396c75ef-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.760259 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.760227    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/022efc78-809a-4b2c-b9f9-3a915de15fe4-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.766788 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.766761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xmd4\" (UniqueName: \"kubernetes.io/projected/d49390f6-ceec-42b8-a2be-38f5396c75ef-kube-api-access-4xmd4\") pod \"payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.766904 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.766794    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgp7\" (UniqueName: \"kubernetes.io/projected/022efc78-809a-4b2c-b9f9-3a915de15fe4-kube-api-access-2sgp7\") pod \"payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:32.854870 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.854849    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:32.875085 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:32.875059    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:33.128817 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:33.128789    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"]
Sep 12 03:09:33.129600 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:09:33.129577    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49390f6_ceec_42b8_a2be_38f5396c75ef.slice/crio-1e899d8792378c99e869f43b8b4da861a411384885647459f54a9fec60105619 WatchSource:0}: Error finding container 1e899d8792378c99e869f43b8b4da861a411384885647459f54a9fec60105619: Status 404 returned error can't find the container with id 1e899d8792378c99e869f43b8b4da861a411384885647459f54a9fec60105619
Sep 12 03:09:33.157089 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:33.157069    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"]
Sep 12 03:09:33.161435 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:09:33.161383    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022efc78_809a_4b2c_b9f9_3a915de15fe4.slice/crio-1d8e6a966fc095c4fb4126eacc489ab109a5467b3792cedd7a195a6cd73df738 WatchSource:0}: Error finding container 1d8e6a966fc095c4fb4126eacc489ab109a5467b3792cedd7a195a6cd73df738: Status 404 returned error can't find the container with id 1d8e6a966fc095c4fb4126eacc489ab109a5467b3792cedd7a195a6cd73df738
Sep 12 03:09:34.015864 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.015825    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx" event={"ID":"022efc78-809a-4b2c-b9f9-3a915de15fe4","Type":"ContainerStarted","Data":"da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82"}
Sep 12 03:09:34.016354 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.015892    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx" event={"ID":"022efc78-809a-4b2c-b9f9-3a915de15fe4","Type":"ContainerStarted","Data":"1d8e6a966fc095c4fb4126eacc489ab109a5467b3792cedd7a195a6cd73df738"}
Sep 12 03:09:34.016354 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.016020    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:34.017601 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.017576    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx" event={"ID":"d49390f6-ceec-42b8-a2be-38f5396c75ef","Type":"ContainerStarted","Data":"389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53"}
Sep 12 03:09:34.017700 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.017621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx" event={"ID":"d49390f6-ceec-42b8-a2be-38f5396c75ef","Type":"ContainerStarted","Data":"1e899d8792378c99e869f43b8b4da861a411384885647459f54a9fec60105619"}
Sep 12 03:09:34.017700 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.017649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:09:34.033176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.033132    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx" podStartSLOduration=2.033120046 podStartE2EDuration="2.033120046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:09:34.031826681 +0000 UTC m=+2006.287807699" watchObservedRunningTime="2026-09-12 03:09:34.033120046 +0000 UTC m=+2006.289101060"
Sep 12 03:09:34.047301 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:34.047252    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx" podStartSLOduration=2.047234953 podStartE2EDuration="2.047234953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:09:34.045603681 +0000 UTC m=+2006.301584704" watchObservedRunningTime="2026-09-12 03:09:34.047234953 +0000 UTC m=+2006.303215971"
Sep 12 03:09:45.025441 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:45.025394    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:09:45.025876 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:09:45.025574    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:10:02.624247 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.624212    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"]
Sep 12 03:10:02.627865 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.627848    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.630613 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.630589    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-27bf83-dockercfg-rzqqj\""
Sep 12 03:10:02.630749 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.630734    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-27bf83\""
Sep 12 03:10:02.638141 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.638118    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"]
Sep 12 03:10:02.730270 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.730228    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmxsv\" (UniqueName: \"kubernetes.io/projected/a04d1607-3e80-42ef-97d8-188286577199-kube-api-access-jmxsv\") pod \"payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.730464 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.730311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04d1607-3e80-42ef-97d8-188286577199-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.831211 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.831172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmxsv\" (UniqueName: \"kubernetes.io/projected/a04d1607-3e80-42ef-97d8-188286577199-kube-api-access-jmxsv\") pod \"payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.831398 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.831242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04d1607-3e80-42ef-97d8-188286577199-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.831920 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.831901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04d1607-3e80-42ef-97d8-188286577199-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.838533 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.838508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmxsv\" (UniqueName: \"kubernetes.io/projected/a04d1607-3e80-42ef-97d8-188286577199-kube-api-access-jmxsv\") pod \"payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:02.940467 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:02.940392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:03.211998 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:03.211973    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"]
Sep 12 03:10:03.213044 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:10:03.213010    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda04d1607_3e80_42ef_97d8_188286577199.slice/crio-cd60420c20c0edd7f57aa63c67599d0a4846113d68af6d5d0e4cf30e3040f10c WatchSource:0}: Error finding container cd60420c20c0edd7f57aa63c67599d0a4846113d68af6d5d0e4cf30e3040f10c: Status 404 returned error can't find the container with id cd60420c20c0edd7f57aa63c67599d0a4846113d68af6d5d0e4cf30e3040f10c
Sep 12 03:10:04.211370 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:04.211336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7" event={"ID":"a04d1607-3e80-42ef-97d8-188286577199","Type":"ContainerStarted","Data":"b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81"}
Sep 12 03:10:04.211830 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:04.211384    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7" event={"ID":"a04d1607-3e80-42ef-97d8-188286577199","Type":"ContainerStarted","Data":"cd60420c20c0edd7f57aa63c67599d0a4846113d68af6d5d0e4cf30e3040f10c"}
Sep 12 03:10:04.211830 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:04.211439    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:10:04.230449 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:04.230394    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7" podStartSLOduration=2.230379563 podStartE2EDuration="2.230379563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:10:04.227921397 +0000 UTC m=+2036.483902411" watchObservedRunningTime="2026-09-12 03:10:04.230379563 +0000 UTC m=+2036.486360578"
Sep 12 03:10:08.781375 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:08.781342    2583 scope.go:117] "RemoveContainer" containerID="93e5aed0699cc621e90c95a5790ada362a90c6809674ca26b44ac4702ce5fc5f"
Sep 12 03:10:15.221193 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:10:15.221164    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:11:08.767934 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:08.767854    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:11:08.771901 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:08.771876    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:11:08.778953 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:08.778932    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:11:08.783436 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:08.783415    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:11:08.802832 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:08.802807    2583 scope.go:117] "RemoveContainer" containerID="2efba0605b9a1bbeb8f535a4ffab99eb7714fd246fa3d58cf5f9344fe4569811"
Sep 12 03:11:08.811780 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:08.811749    2583 scope.go:117] "RemoveContainer" containerID="b5c8902c321918b874e3070cb1c140de67a321183310ded2cdeb37c6168a4019"
Sep 12 03:11:10.974061 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:10.974023    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx_022efc78-809a-4b2c-b9f9-3a915de15fe4/payload-processing/0.log"
Sep 12 03:11:18.721877 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.721836    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"]
Sep 12 03:11:18.725248 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.725227    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:18.728267 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.728248    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-78f530\""
Sep 12 03:11:18.728449 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.728428    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-78f530-dockercfg-xzb9g\""
Sep 12 03:11:18.735239 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.735216    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"]
Sep 12 03:11:18.759367 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.759340    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"]
Sep 12 03:11:18.762813 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.762791    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.769814 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.769792    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"]
Sep 12 03:11:18.851889 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.851852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:18.851889 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.851888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9613c35-452a-4e05-8f7f-1391c67dc5b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.852087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.851912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px4zd\" (UniqueName: \"kubernetes.io/projected/e9613c35-452a-4e05-8f7f-1391c67dc5b2-kube-api-access-px4zd\") pod \"payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.852087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.852046    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh7sf\" (UniqueName: \"kubernetes.io/projected/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-kube-api-access-dh7sf\") pod \"payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:18.953514 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.953484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:18.953678 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.953519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9613c35-452a-4e05-8f7f-1391c67dc5b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.953678 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.953553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px4zd\" (UniqueName: \"kubernetes.io/projected/e9613c35-452a-4e05-8f7f-1391c67dc5b2-kube-api-access-px4zd\") pod \"payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.953678 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.953639    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7sf\" (UniqueName: \"kubernetes.io/projected/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-kube-api-access-dh7sf\") pod \"payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:18.954435 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.954392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:18.954435 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.954392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9613c35-452a-4e05-8f7f-1391c67dc5b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.961557 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.961529    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-px4zd\" (UniqueName: \"kubernetes.io/projected/e9613c35-452a-4e05-8f7f-1391c67dc5b2-kube-api-access-px4zd\") pod \"payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:18.961656 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:18.961623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh7sf\" (UniqueName: \"kubernetes.io/projected/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-kube-api-access-dh7sf\") pod \"payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:19.036703 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.036642    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:19.075206 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.075153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:19.308166 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.308142    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"]
Sep 12 03:11:19.309332 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:11:19.309305    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d8f9fb4_5c57_4ea0_a31d_cbabdb169f4d.slice/crio-ae86a000e09e3c1caae28e89f2e99acb96620cb157242226b077809ea7abf2f5 WatchSource:0}: Error finding container ae86a000e09e3c1caae28e89f2e99acb96620cb157242226b077809ea7abf2f5: Status 404 returned error can't find the container with id ae86a000e09e3c1caae28e89f2e99acb96620cb157242226b077809ea7abf2f5
Sep 12 03:11:19.359208 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.359183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"]
Sep 12 03:11:19.360286 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:11:19.360263    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9613c35_452a_4e05_8f7f_1391c67dc5b2.slice/crio-8b5b76c426d339dbe84508aeb84593b3e8a45b0756503f169a7eea2c8976c081 WatchSource:0}: Error finding container 8b5b76c426d339dbe84508aeb84593b3e8a45b0756503f169a7eea2c8976c081: Status 404 returned error can't find the container with id 8b5b76c426d339dbe84508aeb84593b3e8a45b0756503f169a7eea2c8976c081
Sep 12 03:11:19.667624 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.667577    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn" event={"ID":"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d","Type":"ContainerStarted","Data":"44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121"}
Sep 12 03:11:19.667817 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.667646    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn" event={"ID":"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d","Type":"ContainerStarted","Data":"ae86a000e09e3c1caae28e89f2e99acb96620cb157242226b077809ea7abf2f5"}
Sep 12 03:11:19.667817 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.667748    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:19.669228 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.669195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz" event={"ID":"e9613c35-452a-4e05-8f7f-1391c67dc5b2","Type":"ContainerStarted","Data":"fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14"}
Sep 12 03:11:19.669350 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.669246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz" event={"ID":"e9613c35-452a-4e05-8f7f-1391c67dc5b2","Type":"ContainerStarted","Data":"8b5b76c426d339dbe84508aeb84593b3e8a45b0756503f169a7eea2c8976c081"}
Sep 12 03:11:19.669350 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.669272    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:19.683005 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.682962    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn" podStartSLOduration=1.682948196 podStartE2EDuration="1.682948196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:11:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:11:19.68159495 +0000 UTC m=+2111.937575966" watchObservedRunningTime="2026-09-12 03:11:19.682948196 +0000 UTC m=+2111.938929212"
Sep 12 03:11:19.697164 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:19.697119    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz" podStartSLOduration=1.697106392 podStartE2EDuration="1.697106392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:11:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:11:19.695318344 +0000 UTC m=+2111.951299362" watchObservedRunningTime="2026-09-12 03:11:19.697106392 +0000 UTC m=+2111.953087406"
Sep 12 03:11:30.676609 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:30.676572    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:30.677010 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:30.676958    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:46.078054 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.078019    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"]
Sep 12 03:11:46.081684 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.081668    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:46.084991 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.084854    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:11:46.085149 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.085105    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:11:46.088088 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.088067    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"]
Sep 12 03:11:46.205593 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.205563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06086e-8687-4341-9314-268ade3c6c7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w\" (UID: \"8a06086e-8687-4341-9314-268ade3c6c7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:46.307263 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.307232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06086e-8687-4341-9314-268ade3c6c7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w\" (UID: \"8a06086e-8687-4341-9314-268ade3c6c7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:46.307852 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.307832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06086e-8687-4341-9314-268ade3c6c7e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w\" (UID: \"8a06086e-8687-4341-9314-268ade3c6c7e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:46.393582 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.393515    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:46.671532 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.667330    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"]
Sep 12 03:11:46.836724 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:46.836692    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w" event={"ID":"8a06086e-8687-4341-9314-268ade3c6c7e","Type":"ContainerStarted","Data":"0749bb0762c962621132582cdeb39da9312ff0471baf217264725e0b3e7e9984"}
Sep 12 03:11:47.845022 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:47.844992    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a06086e-8687-4341-9314-268ade3c6c7e" containerID="585c7c9a080aacf9a60703ad4676d1bd0dc7fc8bc35f038ccfc782de349f209f" exitCode=0
Sep 12 03:11:47.845381 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:47.845077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w" event={"ID":"8a06086e-8687-4341-9314-268ade3c6c7e","Type":"ContainerDied","Data":"585c7c9a080aacf9a60703ad4676d1bd0dc7fc8bc35f038ccfc782de349f209f"}
Sep 12 03:11:48.976048 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:48.976025    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:49.136769 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:49.136690    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06086e-8687-4341-9314-268ade3c6c7e-maas-api-service-ca\") pod \"8a06086e-8687-4341-9314-268ade3c6c7e\" (UID: \"8a06086e-8687-4341-9314-268ade3c6c7e\") "
Sep 12 03:11:49.137054 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:49.137030    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a06086e-8687-4341-9314-268ade3c6c7e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a06086e-8687-4341-9314-268ade3c6c7e" (UID: "8a06086e-8687-4341-9314-268ade3c6c7e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:11:49.137116 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:49.137095    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a06086e-8687-4341-9314-268ade3c6c7e-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:11:49.857493 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:49.857464    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"
Sep 12 03:11:49.857493 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:49.857491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w" event={"ID":"8a06086e-8687-4341-9314-268ade3c6c7e","Type":"ContainerDied","Data":"0749bb0762c962621132582cdeb39da9312ff0471baf217264725e0b3e7e9984"}
Sep 12 03:11:49.857713 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:49.857535    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0749bb0762c962621132582cdeb39da9312ff0471baf217264725e0b3e7e9984"
Sep 12 03:11:56.913952 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:56.913891    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"]
Sep 12 03:11:56.914470 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:56.914185    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn" podUID="6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" containerName="payload-pre-processing" containerID="cri-o://44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121" gracePeriod=30
Sep 12 03:11:56.917165 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:56.917137    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"]
Sep 12 03:11:56.917521 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:56.917473    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz" podUID="e9613c35-452a-4e05-8f7f-1391c67dc5b2" containerName="payload-processing" containerID="cri-o://fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14" gracePeriod=30
Sep 12 03:11:57.075179 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.075055    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"]
Sep 12 03:11:57.079689 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.079657    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-78f530-8qf7w"]
Sep 12 03:11:57.176475 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.176419    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:57.203540 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.203518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:57.213450 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.213429    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh7sf\" (UniqueName: \"kubernetes.io/projected/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-kube-api-access-dh7sf\") pod \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") "
Sep 12 03:11:57.213539 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.213498    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-px4zd\" (UniqueName: \"kubernetes.io/projected/e9613c35-452a-4e05-8f7f-1391c67dc5b2-kube-api-access-px4zd\") pod \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") "
Sep 12 03:11:57.213596 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.213573    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-plugins-config-volume\") pod \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\" (UID: \"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d\") "
Sep 12 03:11:57.213654 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.213620    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9613c35-452a-4e05-8f7f-1391c67dc5b2-plugins-config-volume\") pod \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\" (UID: \"e9613c35-452a-4e05-8f7f-1391c67dc5b2\") "
Sep 12 03:11:57.214014 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.213984    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" (UID: "6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:11:57.214121 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.214019    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9613c35-452a-4e05-8f7f-1391c67dc5b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e9613c35-452a-4e05-8f7f-1391c67dc5b2" (UID: "e9613c35-452a-4e05-8f7f-1391c67dc5b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:11:57.215528 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.215498    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-kube-api-access-dh7sf" (OuterVolumeSpecName: "kube-api-access-dh7sf") pod "6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" (UID: "6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d"). InnerVolumeSpecName "kube-api-access-dh7sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:11:57.215634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.215580    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9613c35-452a-4e05-8f7f-1391c67dc5b2-kube-api-access-px4zd" (OuterVolumeSpecName: "kube-api-access-px4zd") pod "e9613c35-452a-4e05-8f7f-1391c67dc5b2" (UID: "e9613c35-452a-4e05-8f7f-1391c67dc5b2"). InnerVolumeSpecName "kube-api-access-px4zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:11:57.314522 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.314488    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e9613c35-452a-4e05-8f7f-1391c67dc5b2-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:11:57.314522 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.314516    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh7sf\" (UniqueName: \"kubernetes.io/projected/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-kube-api-access-dh7sf\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:11:57.314522 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.314526    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-px4zd\" (UniqueName: \"kubernetes.io/projected/e9613c35-452a-4e05-8f7f-1391c67dc5b2-kube-api-access-px4zd\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:11:57.314765 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.314534    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:11:57.910885 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.910850    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9613c35-452a-4e05-8f7f-1391c67dc5b2" containerID="fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14" exitCode=0
Sep 12 03:11:57.911087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.910893    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"
Sep 12 03:11:57.911087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.910937    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz" event={"ID":"e9613c35-452a-4e05-8f7f-1391c67dc5b2","Type":"ContainerDied","Data":"fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14"}
Sep 12 03:11:57.911087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.911015    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz" event={"ID":"e9613c35-452a-4e05-8f7f-1391c67dc5b2","Type":"ContainerDied","Data":"8b5b76c426d339dbe84508aeb84593b3e8a45b0756503f169a7eea2c8976c081"}
Sep 12 03:11:57.911087 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.911040    2583 scope.go:117] "RemoveContainer" containerID="fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14"
Sep 12 03:11:57.912554 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.912532    2583 generic.go:356] "Generic (PLEG): container finished" podID="6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" containerID="44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121" exitCode=0
Sep 12 03:11:57.912670 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.912564    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"
Sep 12 03:11:57.912670 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.912579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn" event={"ID":"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d","Type":"ContainerDied","Data":"44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121"}
Sep 12 03:11:57.912670 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.912608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn" event={"ID":"6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d","Type":"ContainerDied","Data":"ae86a000e09e3c1caae28e89f2e99acb96620cb157242226b077809ea7abf2f5"}
Sep 12 03:11:57.923067 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.922577    2583 scope.go:117] "RemoveContainer" containerID="fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14"
Sep 12 03:11:57.923067 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:11:57.922985    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14\": container with ID starting with fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14 not found: ID does not exist" containerID="fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14"
Sep 12 03:11:57.923067 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.923008    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14"} err="failed to get container status \"fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14\": rpc error: code = NotFound desc = could not find container \"fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14\": container with ID starting with fd4790875f0cb47c2ad16206472cfc11c530405510a2261f993642362b8cac14 not found: ID does not exist"
Sep 12 03:11:57.923067 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.923024    2583 scope.go:117] "RemoveContainer" containerID="44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121"
Sep 12 03:11:57.932923 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.932905    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"]
Sep 12 03:11:57.937239 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.937220    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-78f530-58cfcffbd5-s2wfz"]
Sep 12 03:11:57.938843 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.938829    2583 scope.go:117] "RemoveContainer" containerID="44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121"
Sep 12 03:11:57.939104 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:11:57.939086    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121\": container with ID starting with 44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121 not found: ID does not exist" containerID="44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121"
Sep 12 03:11:57.939152 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.939112    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121"} err="failed to get container status \"44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121\": rpc error: code = NotFound desc = could not find container \"44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121\": container with ID starting with 44a5e7441f818d223faac188b843706d71ff1760ee70c12c7763c8e81e81d121 not found: ID does not exist"
Sep 12 03:11:57.946057 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.946037    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"]
Sep 12 03:11:57.950438 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:57.950417    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-78f530-7d54845bcd-nw4kn"]
Sep 12 03:11:58.162926 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:58.162843    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" path="/var/lib/kubelet/pods/6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d/volumes"
Sep 12 03:11:58.163302 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:58.163282    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a06086e-8687-4341-9314-268ade3c6c7e" path="/var/lib/kubelet/pods/8a06086e-8687-4341-9314-268ade3c6c7e/volumes"
Sep 12 03:11:58.163709 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:11:58.163691    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9613c35-452a-4e05-8f7f-1391c67dc5b2" path="/var/lib/kubelet/pods/e9613c35-452a-4e05-8f7f-1391c67dc5b2/volumes"
Sep 12 03:12:07.452272 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452196    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"]
Sep 12 03:12:07.452631 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452619    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9613c35-452a-4e05-8f7f-1391c67dc5b2" containerName="payload-processing"
Sep 12 03:12:07.452676 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452633    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9613c35-452a-4e05-8f7f-1391c67dc5b2" containerName="payload-processing"
Sep 12 03:12:07.452676 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452659    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" containerName="payload-pre-processing"
Sep 12 03:12:07.452676 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452664    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" containerName="payload-pre-processing"
Sep 12 03:12:07.452774 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452677    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a06086e-8687-4341-9314-268ade3c6c7e" containerName="revoke-keys"
Sep 12 03:12:07.452774 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452683    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a06086e-8687-4341-9314-268ade3c6c7e" containerName="revoke-keys"
Sep 12 03:12:07.452774 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452747    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d8f9fb4-5c57-4ea0-a31d-cbabdb169f4d" containerName="payload-pre-processing"
Sep 12 03:12:07.452774 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452754    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a06086e-8687-4341-9314-268ade3c6c7e" containerName="revoke-keys"
Sep 12 03:12:07.452774 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.452762    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9613c35-452a-4e05-8f7f-1391c67dc5b2" containerName="payload-processing"
Sep 12 03:12:07.457282 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.457266    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:07.460633 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.460605    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:12:07.460781 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.460637    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:12:07.467635 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.465625    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"]
Sep 12 03:12:07.506819 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.506793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dfe92c-8b7f-4955-9201-e497680b0130-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb\" (UID: \"c7dfe92c-8b7f-4955-9201-e497680b0130\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:07.607710 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.607683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dfe92c-8b7f-4955-9201-e497680b0130-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb\" (UID: \"c7dfe92c-8b7f-4955-9201-e497680b0130\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:07.608275 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.608254    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dfe92c-8b7f-4955-9201-e497680b0130-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb\" (UID: \"c7dfe92c-8b7f-4955-9201-e497680b0130\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:07.776814 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:07.776740    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:08.046292 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.046253    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"]
Sep 12 03:12:08.047339 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:12:08.047311    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7dfe92c_8b7f_4955_9201_e497680b0130.slice/crio-e64cf374c2c26791154c150070319e5d112988b00dd541082b64e7d54d6e78d1 WatchSource:0}: Error finding container e64cf374c2c26791154c150070319e5d112988b00dd541082b64e7d54d6e78d1: Status 404 returned error can't find the container with id e64cf374c2c26791154c150070319e5d112988b00dd541082b64e7d54d6e78d1
Sep 12 03:12:08.837875 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.837847    2583 scope.go:117] "RemoveContainer" containerID="4f4092d6bac84b94e29ef2a0683c74e7e681b68d2547129566772ebaf0b045c2"
Sep 12 03:12:08.846741 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.846722    2583 scope.go:117] "RemoveContainer" containerID="e51090beecc094f7989c194d85b2705e7ba5adc1675191155f59f4ba81a42ac6"
Sep 12 03:12:08.855371 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.855353    2583 scope.go:117] "RemoveContainer" containerID="fa1fdefc7311fbc1f79dd0ef6d70740377ece40edb68d79325d22294a25835d3"
Sep 12 03:12:08.984707 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.984645    2583 generic.go:356] "Generic (PLEG): container finished" podID="c7dfe92c-8b7f-4955-9201-e497680b0130" containerID="94c9feb6bd40e28f238024ea7720689d6b039566330528980be176ebe1532953" exitCode=0
Sep 12 03:12:08.984812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.984736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb" event={"ID":"c7dfe92c-8b7f-4955-9201-e497680b0130","Type":"ContainerDied","Data":"94c9feb6bd40e28f238024ea7720689d6b039566330528980be176ebe1532953"}
Sep 12 03:12:08.984812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:08.984790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb" event={"ID":"c7dfe92c-8b7f-4955-9201-e497680b0130","Type":"ContainerStarted","Data":"e64cf374c2c26791154c150070319e5d112988b00dd541082b64e7d54d6e78d1"}
Sep 12 03:12:10.132363 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.132336    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:10.230826 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.230795    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dfe92c-8b7f-4955-9201-e497680b0130-maas-api-service-ca\") pod \"c7dfe92c-8b7f-4955-9201-e497680b0130\" (UID: \"c7dfe92c-8b7f-4955-9201-e497680b0130\") "
Sep 12 03:12:10.231209 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.231166    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7dfe92c-8b7f-4955-9201-e497680b0130-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c7dfe92c-8b7f-4955-9201-e497680b0130" (UID: "c7dfe92c-8b7f-4955-9201-e497680b0130"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:12:10.331911 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.331863    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7dfe92c-8b7f-4955-9201-e497680b0130-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:12:10.997547 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.997521    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"
Sep 12 03:12:10.997698 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.997544    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb" event={"ID":"c7dfe92c-8b7f-4955-9201-e497680b0130","Type":"ContainerDied","Data":"e64cf374c2c26791154c150070319e5d112988b00dd541082b64e7d54d6e78d1"}
Sep 12 03:12:10.997698 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:10.997588    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e64cf374c2c26791154c150070319e5d112988b00dd541082b64e7d54d6e78d1"
Sep 12 03:12:23.193562 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.193528    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"]
Sep 12 03:12:23.194450 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.194183    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx" podUID="022efc78-809a-4b2c-b9f9-3a915de15fe4" containerName="payload-processing" containerID="cri-o://da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82" gracePeriod=30
Sep 12 03:12:23.199020 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.198991    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"]
Sep 12 03:12:23.199272 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.199222    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx" podUID="d49390f6-ceec-42b8-a2be-38f5396c75ef" containerName="payload-pre-processing" containerID="cri-o://389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53" gracePeriod=30
Sep 12 03:12:23.337209 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.337144    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"]
Sep 12 03:12:23.340890 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.340864    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-ad5a1b-gtqcb"]
Sep 12 03:12:23.476219 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.476197    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:12:23.479510 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.479486    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:12:23.550425 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.550384    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sgp7\" (UniqueName: \"kubernetes.io/projected/022efc78-809a-4b2c-b9f9-3a915de15fe4-kube-api-access-2sgp7\") pod \"022efc78-809a-4b2c-b9f9-3a915de15fe4\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") "
Sep 12 03:12:23.550585 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.550486    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xmd4\" (UniqueName: \"kubernetes.io/projected/d49390f6-ceec-42b8-a2be-38f5396c75ef-kube-api-access-4xmd4\") pod \"d49390f6-ceec-42b8-a2be-38f5396c75ef\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") "
Sep 12 03:12:23.550585 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.550514    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/022efc78-809a-4b2c-b9f9-3a915de15fe4-plugins-config-volume\") pod \"022efc78-809a-4b2c-b9f9-3a915de15fe4\" (UID: \"022efc78-809a-4b2c-b9f9-3a915de15fe4\") "
Sep 12 03:12:23.550585 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.550540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d49390f6-ceec-42b8-a2be-38f5396c75ef-plugins-config-volume\") pod \"d49390f6-ceec-42b8-a2be-38f5396c75ef\" (UID: \"d49390f6-ceec-42b8-a2be-38f5396c75ef\") "
Sep 12 03:12:23.550915 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.550887    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/022efc78-809a-4b2c-b9f9-3a915de15fe4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "022efc78-809a-4b2c-b9f9-3a915de15fe4" (UID: "022efc78-809a-4b2c-b9f9-3a915de15fe4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:12:23.551011 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.550909    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d49390f6-ceec-42b8-a2be-38f5396c75ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d49390f6-ceec-42b8-a2be-38f5396c75ef" (UID: "d49390f6-ceec-42b8-a2be-38f5396c75ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:12:23.552553 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.552532    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/022efc78-809a-4b2c-b9f9-3a915de15fe4-kube-api-access-2sgp7" (OuterVolumeSpecName: "kube-api-access-2sgp7") pod "022efc78-809a-4b2c-b9f9-3a915de15fe4" (UID: "022efc78-809a-4b2c-b9f9-3a915de15fe4"). InnerVolumeSpecName "kube-api-access-2sgp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:12:23.552674 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.552636    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d49390f6-ceec-42b8-a2be-38f5396c75ef-kube-api-access-4xmd4" (OuterVolumeSpecName: "kube-api-access-4xmd4") pod "d49390f6-ceec-42b8-a2be-38f5396c75ef" (UID: "d49390f6-ceec-42b8-a2be-38f5396c75ef"). InnerVolumeSpecName "kube-api-access-4xmd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:12:23.651494 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.651461    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sgp7\" (UniqueName: \"kubernetes.io/projected/022efc78-809a-4b2c-b9f9-3a915de15fe4-kube-api-access-2sgp7\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:12:23.651494 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.651486    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xmd4\" (UniqueName: \"kubernetes.io/projected/d49390f6-ceec-42b8-a2be-38f5396c75ef-kube-api-access-4xmd4\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:12:23.651494 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.651496    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/022efc78-809a-4b2c-b9f9-3a915de15fe4-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:12:23.651494 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:23.651505    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d49390f6-ceec-42b8-a2be-38f5396c75ef-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:12:24.079289 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.079254    2583 generic.go:356] "Generic (PLEG): container finished" podID="022efc78-809a-4b2c-b9f9-3a915de15fe4" containerID="da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82" exitCode=0
Sep 12 03:12:24.079459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.079294    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"
Sep 12 03:12:24.079459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.079336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx" event={"ID":"022efc78-809a-4b2c-b9f9-3a915de15fe4","Type":"ContainerDied","Data":"da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82"}
Sep 12 03:12:24.079459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.079387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx" event={"ID":"022efc78-809a-4b2c-b9f9-3a915de15fe4","Type":"ContainerDied","Data":"1d8e6a966fc095c4fb4126eacc489ab109a5467b3792cedd7a195a6cd73df738"}
Sep 12 03:12:24.079459 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.079443    2583 scope.go:117] "RemoveContainer" containerID="da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82"
Sep 12 03:12:24.080771 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.080749    2583 generic.go:356] "Generic (PLEG): container finished" podID="d49390f6-ceec-42b8-a2be-38f5396c75ef" containerID="389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53" exitCode=0
Sep 12 03:12:24.080886 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.080785    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"
Sep 12 03:12:24.080886 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.080830    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx" event={"ID":"d49390f6-ceec-42b8-a2be-38f5396c75ef","Type":"ContainerDied","Data":"389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53"}
Sep 12 03:12:24.080886 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.080869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx" event={"ID":"d49390f6-ceec-42b8-a2be-38f5396c75ef","Type":"ContainerDied","Data":"1e899d8792378c99e869f43b8b4da861a411384885647459f54a9fec60105619"}
Sep 12 03:12:24.090256 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.090240    2583 scope.go:117] "RemoveContainer" containerID="da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82"
Sep 12 03:12:24.090550 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:12:24.090530    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82\": container with ID starting with da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82 not found: ID does not exist" containerID="da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82"
Sep 12 03:12:24.090637 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.090557    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82"} err="failed to get container status \"da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82\": rpc error: code = NotFound desc = could not find container \"da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82\": container with ID starting with da048decaa8bc0b643cc3c1e9433765f730e306d13e0f02563603806513d1a82 not found: ID does not exist"
Sep 12 03:12:24.090637 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.090572    2583 scope.go:117] "RemoveContainer" containerID="389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53"
Sep 12 03:12:24.102432 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.102383    2583 scope.go:117] "RemoveContainer" containerID="389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53"
Sep 12 03:12:24.102740 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:12:24.102720    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53\": container with ID starting with 389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53 not found: ID does not exist" containerID="389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53"
Sep 12 03:12:24.102813 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.102752    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53"} err="failed to get container status \"389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53\": rpc error: code = NotFound desc = could not find container \"389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53\": container with ID starting with 389b571ab018083a427bc489966a9457401ba035f1467fee18a5d488c28d6b53 not found: ID does not exist"
Sep 12 03:12:24.103591 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.103572    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"]
Sep 12 03:12:24.108570 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.108545    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-ad5a1b-6c7859856f-6d4bx"]
Sep 12 03:12:24.118660 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.118640    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"]
Sep 12 03:12:24.121176 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.121158    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-ad5a1b-8559657b74-hmtjx"]
Sep 12 03:12:24.161629 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.161605    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="022efc78-809a-4b2c-b9f9-3a915de15fe4" path="/var/lib/kubelet/pods/022efc78-809a-4b2c-b9f9-3a915de15fe4/volumes"
Sep 12 03:12:24.161924 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.161912    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7dfe92c-8b7f-4955-9201-e497680b0130" path="/var/lib/kubelet/pods/c7dfe92c-8b7f-4955-9201-e497680b0130/volumes"
Sep 12 03:12:24.162231 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:12:24.162220    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d49390f6-ceec-42b8-a2be-38f5396c75ef" path="/var/lib/kubelet/pods/d49390f6-ceec-42b8-a2be-38f5396c75ef/volumes"
Sep 12 03:13:12.198000 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.197967    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"]
Sep 12 03:13:12.198387 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198363    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d49390f6-ceec-42b8-a2be-38f5396c75ef" containerName="payload-pre-processing"
Sep 12 03:13:12.198387 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198380    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d49390f6-ceec-42b8-a2be-38f5396c75ef" containerName="payload-pre-processing"
Sep 12 03:13:12.198501 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198394    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="022efc78-809a-4b2c-b9f9-3a915de15fe4" containerName="payload-processing"
Sep 12 03:13:12.198501 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198400    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="022efc78-809a-4b2c-b9f9-3a915de15fe4" containerName="payload-processing"
Sep 12 03:13:12.198501 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198455    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7dfe92c-8b7f-4955-9201-e497680b0130" containerName="revoke-keys"
Sep 12 03:13:12.198501 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198461    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7dfe92c-8b7f-4955-9201-e497680b0130" containerName="revoke-keys"
Sep 12 03:13:12.198627 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198527    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="022efc78-809a-4b2c-b9f9-3a915de15fe4" containerName="payload-processing"
Sep 12 03:13:12.198627 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198536    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d49390f6-ceec-42b8-a2be-38f5396c75ef" containerName="payload-pre-processing"
Sep 12 03:13:12.198627 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.198545    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7dfe92c-8b7f-4955-9201-e497680b0130" containerName="revoke-keys"
Sep 12 03:13:12.203006 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.202992    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:12.205490 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.205463    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:13:12.205627 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.205605    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:13:12.207771 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.207744    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"]
Sep 12 03:13:12.322511 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.322482    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c5edcb-6ff2-4f71-b1f4-2c0805d73867-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz\" (UID: \"64c5edcb-6ff2-4f71-b1f4-2c0805d73867\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:12.423756 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.423730    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c5edcb-6ff2-4f71-b1f4-2c0805d73867-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz\" (UID: \"64c5edcb-6ff2-4f71-b1f4-2c0805d73867\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:12.424335 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.424317    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c5edcb-6ff2-4f71-b1f4-2c0805d73867-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz\" (UID: \"64c5edcb-6ff2-4f71-b1f4-2c0805d73867\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:12.514992 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.514926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:12.784239 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:12.784216    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"]
Sep 12 03:13:12.786423 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:13:12.786371    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c5edcb_6ff2_4f71_b1f4_2c0805d73867.slice/crio-76ed81a87dfefca3934ea7923474d033b667c93733276936970698017a995335 WatchSource:0}: Error finding container 76ed81a87dfefca3934ea7923474d033b667c93733276936970698017a995335: Status 404 returned error can't find the container with id 76ed81a87dfefca3934ea7923474d033b667c93733276936970698017a995335
Sep 12 03:13:13.377125 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:13.377033    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz" event={"ID":"64c5edcb-6ff2-4f71-b1f4-2c0805d73867","Type":"ContainerStarted","Data":"a2880f3c258b5d6e3753145679fb1bdd63fbfcd7e63b694c39fd0c65169f8188"}
Sep 12 03:13:13.377125 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:13.377084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz" event={"ID":"64c5edcb-6ff2-4f71-b1f4-2c0805d73867","Type":"ContainerStarted","Data":"76ed81a87dfefca3934ea7923474d033b667c93733276936970698017a995335"}
Sep 12 03:13:13.393468 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:13.393424    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz" podStartSLOduration=1.393389921 podStartE2EDuration="1.393389921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:13:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:13:13.393044882 +0000 UTC m=+2225.649025901" watchObservedRunningTime="2026-09-12 03:13:13.393389921 +0000 UTC m=+2225.649370935"
Sep 12 03:13:14.384129 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:14.384089    2583 generic.go:356] "Generic (PLEG): container finished" podID="64c5edcb-6ff2-4f71-b1f4-2c0805d73867" containerID="a2880f3c258b5d6e3753145679fb1bdd63fbfcd7e63b694c39fd0c65169f8188" exitCode=0
Sep 12 03:13:14.384597 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:14.384163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz" event={"ID":"64c5edcb-6ff2-4f71-b1f4-2c0805d73867","Type":"ContainerDied","Data":"a2880f3c258b5d6e3753145679fb1bdd63fbfcd7e63b694c39fd0c65169f8188"}
Sep 12 03:13:15.529471 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:15.529446    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:15.654473 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:15.654369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c5edcb-6ff2-4f71-b1f4-2c0805d73867-maas-api-service-ca\") pod \"64c5edcb-6ff2-4f71-b1f4-2c0805d73867\" (UID: \"64c5edcb-6ff2-4f71-b1f4-2c0805d73867\") "
Sep 12 03:13:15.654742 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:15.654720    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64c5edcb-6ff2-4f71-b1f4-2c0805d73867-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "64c5edcb-6ff2-4f71-b1f4-2c0805d73867" (UID: "64c5edcb-6ff2-4f71-b1f4-2c0805d73867"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:15.755995 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:15.755958    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c5edcb-6ff2-4f71-b1f4-2c0805d73867-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:16.396834 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:16.396802    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"
Sep 12 03:13:16.397033 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:16.396804    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz" event={"ID":"64c5edcb-6ff2-4f71-b1f4-2c0805d73867","Type":"ContainerDied","Data":"76ed81a87dfefca3934ea7923474d033b667c93733276936970698017a995335"}
Sep 12 03:13:16.397033 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:16.396922    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ed81a87dfefca3934ea7923474d033b667c93733276936970698017a995335"
Sep 12 03:13:22.797201 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:22.797166    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"]
Sep 12 03:13:22.797679 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:22.797451    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7" podUID="a04d1607-3e80-42ef-97d8-188286577199" containerName="payload-pre-processing" containerID="cri-o://b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81" gracePeriod=30
Sep 12 03:13:22.946916 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:22.946880    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"]
Sep 12 03:13:22.951026 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:22.950998    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-27bf83-xpwkz"]
Sep 12 03:13:23.073542 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.073517    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:13:23.228607 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.228581    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04d1607-3e80-42ef-97d8-188286577199-plugins-config-volume\") pod \"a04d1607-3e80-42ef-97d8-188286577199\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") "
Sep 12 03:13:23.228786 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.228617    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmxsv\" (UniqueName: \"kubernetes.io/projected/a04d1607-3e80-42ef-97d8-188286577199-kube-api-access-jmxsv\") pod \"a04d1607-3e80-42ef-97d8-188286577199\" (UID: \"a04d1607-3e80-42ef-97d8-188286577199\") "
Sep 12 03:13:23.228973 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.228951    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a04d1607-3e80-42ef-97d8-188286577199-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a04d1607-3e80-42ef-97d8-188286577199" (UID: "a04d1607-3e80-42ef-97d8-188286577199"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:23.230707 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.230683    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a04d1607-3e80-42ef-97d8-188286577199-kube-api-access-jmxsv" (OuterVolumeSpecName: "kube-api-access-jmxsv") pod "a04d1607-3e80-42ef-97d8-188286577199" (UID: "a04d1607-3e80-42ef-97d8-188286577199"). InnerVolumeSpecName "kube-api-access-jmxsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:13:23.329620 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.329580    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a04d1607-3e80-42ef-97d8-188286577199-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:23.329620 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.329613    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmxsv\" (UniqueName: \"kubernetes.io/projected/a04d1607-3e80-42ef-97d8-188286577199-kube-api-access-jmxsv\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:23.440075 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.440040    2583 generic.go:356] "Generic (PLEG): container finished" podID="a04d1607-3e80-42ef-97d8-188286577199" containerID="b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81" exitCode=0
Sep 12 03:13:23.440251 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.440093    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"
Sep 12 03:13:23.440251 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.440126    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7" event={"ID":"a04d1607-3e80-42ef-97d8-188286577199","Type":"ContainerDied","Data":"b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81"}
Sep 12 03:13:23.440251 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.440184    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7" event={"ID":"a04d1607-3e80-42ef-97d8-188286577199","Type":"ContainerDied","Data":"cd60420c20c0edd7f57aa63c67599d0a4846113d68af6d5d0e4cf30e3040f10c"}
Sep 12 03:13:23.440251 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.440207    2583 scope.go:117] "RemoveContainer" containerID="b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81"
Sep 12 03:13:23.452372 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.452351    2583 scope.go:117] "RemoveContainer" containerID="b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81"
Sep 12 03:13:23.452679 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:13:23.452659    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81\": container with ID starting with b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81 not found: ID does not exist" containerID="b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81"
Sep 12 03:13:23.452743 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.452689    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81"} err="failed to get container status \"b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81\": rpc error: code = NotFound desc = could not find container \"b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81\": container with ID starting with b70f8a1b18f57a4aed38a4efffced0b9f5cf664b748baba1108e1f75aa85fe81 not found: ID does not exist"
Sep 12 03:13:23.466218 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.466198    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"]
Sep 12 03:13:23.471985 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:23.471962    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-27bf83-85b7d85c7d-jx8w7"]
Sep 12 03:13:24.162351 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:24.162319    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64c5edcb-6ff2-4f71-b1f4-2c0805d73867" path="/var/lib/kubelet/pods/64c5edcb-6ff2-4f71-b1f4-2c0805d73867/volumes"
Sep 12 03:13:24.162748 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:24.162736    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a04d1607-3e80-42ef-97d8-188286577199" path="/var/lib/kubelet/pods/a04d1607-3e80-42ef-97d8-188286577199/volumes"
Sep 12 03:13:29.789771 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.789734    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"]
Sep 12 03:13:29.790340 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.790323    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64c5edcb-6ff2-4f71-b1f4-2c0805d73867" containerName="revoke-keys"
Sep 12 03:13:29.790387 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.790342    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="64c5edcb-6ff2-4f71-b1f4-2c0805d73867" containerName="revoke-keys"
Sep 12 03:13:29.790387 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.790353    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a04d1607-3e80-42ef-97d8-188286577199" containerName="payload-pre-processing"
Sep 12 03:13:29.790387 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.790359    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a04d1607-3e80-42ef-97d8-188286577199" containerName="payload-pre-processing"
Sep 12 03:13:29.790522 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.790484    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a04d1607-3e80-42ef-97d8-188286577199" containerName="payload-pre-processing"
Sep 12 03:13:29.790522 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.790496    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="64c5edcb-6ff2-4f71-b1f4-2c0805d73867" containerName="revoke-keys"
Sep 12 03:13:29.794940 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.794925    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:29.797389 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.797360    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:13:29.797559 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.797498    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:13:29.801902 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.801879    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"]
Sep 12 03:13:29.891561 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.891526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq\" (UID: \"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:29.992173 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.992136    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq\" (UID: \"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:29.992839 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:29.992811    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq\" (UID: \"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:30.107526 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:30.107479    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:30.379123 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:30.379095    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"]
Sep 12 03:13:30.380190 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:13:30.380164    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68da5c2a_4be2_47b4_b6ee_f02f640d1d5a.slice/crio-1ae67aff70b143c9cbed3b2a8722ff0e3d640b796f13711e98c592b3a745c2b7 WatchSource:0}: Error finding container 1ae67aff70b143c9cbed3b2a8722ff0e3d640b796f13711e98c592b3a745c2b7: Status 404 returned error can't find the container with id 1ae67aff70b143c9cbed3b2a8722ff0e3d640b796f13711e98c592b3a745c2b7
Sep 12 03:13:30.484465 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:30.484430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq" event={"ID":"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a","Type":"ContainerStarted","Data":"1ae67aff70b143c9cbed3b2a8722ff0e3d640b796f13711e98c592b3a745c2b7"}
Sep 12 03:13:31.491712 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:31.491679    2583 generic.go:356] "Generic (PLEG): container finished" podID="68da5c2a-4be2-47b4-b6ee-f02f640d1d5a" containerID="1b3eb9fd4ccdf9f39fbe4a970618d459844b17f10e63aed591dece5c57246dca" exitCode=0
Sep 12 03:13:31.492083 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:31.491768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq" event={"ID":"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a","Type":"ContainerDied","Data":"1b3eb9fd4ccdf9f39fbe4a970618d459844b17f10e63aed591dece5c57246dca"}
Sep 12 03:13:32.630741 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:32.630715    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:32.719827 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:32.719795    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a-maas-api-service-ca\") pod \"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a\" (UID: \"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a\") "
Sep 12 03:13:32.720180 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:32.720157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68da5c2a-4be2-47b4-b6ee-f02f640d1d5a" (UID: "68da5c2a-4be2-47b4-b6ee-f02f640d1d5a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:32.821379 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:32.821349    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:33.504854 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:33.504826    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"
Sep 12 03:13:33.504854 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:33.504837    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq" event={"ID":"68da5c2a-4be2-47b4-b6ee-f02f640d1d5a","Type":"ContainerDied","Data":"1ae67aff70b143c9cbed3b2a8722ff0e3d640b796f13711e98c592b3a745c2b7"}
Sep 12 03:13:33.505146 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:33.504879    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ae67aff70b143c9cbed3b2a8722ff0e3d640b796f13711e98c592b3a745c2b7"
Sep 12 03:13:40.285950 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.285916    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"]
Sep 12 03:13:40.286456 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.286249    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf" podUID="7b5d5e74-675a-45a3-8872-ad9e5970a3c0" containerName="payload-pre-processing" containerID="cri-o://ac06df3bb4b1a44fa43da75f215501c39dd5a332ce1b1331d4042ef14fc417f5" gracePeriod=30
Sep 12 03:13:40.435781 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.435746    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"]
Sep 12 03:13:40.438116 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.438091    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f91169-55gdq"]
Sep 12 03:13:40.546634 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.546605    2583 generic.go:356] "Generic (PLEG): container finished" podID="7b5d5e74-675a-45a3-8872-ad9e5970a3c0" containerID="ac06df3bb4b1a44fa43da75f215501c39dd5a332ce1b1331d4042ef14fc417f5" exitCode=0
Sep 12 03:13:40.546772 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.546688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf" event={"ID":"7b5d5e74-675a-45a3-8872-ad9e5970a3c0","Type":"ContainerDied","Data":"ac06df3bb4b1a44fa43da75f215501c39dd5a332ce1b1331d4042ef14fc417f5"}
Sep 12 03:13:40.546772 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.546739    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf" event={"ID":"7b5d5e74-675a-45a3-8872-ad9e5970a3c0","Type":"ContainerDied","Data":"ed39672e59beb9ae72e01ab3f27698512db7487c17d3872ea0f723cf43fb4aac"}
Sep 12 03:13:40.546772 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.546755    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed39672e59beb9ae72e01ab3f27698512db7487c17d3872ea0f723cf43fb4aac"
Sep 12 03:13:40.553038 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.553021    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:13:40.588861 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.588836    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7cgm\" (UniqueName: \"kubernetes.io/projected/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-kube-api-access-d7cgm\") pod \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") "
Sep 12 03:13:40.588991 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.588927    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-plugins-config-volume\") pod \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\" (UID: \"7b5d5e74-675a-45a3-8872-ad9e5970a3c0\") "
Sep 12 03:13:40.589288 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.589264    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b5d5e74-675a-45a3-8872-ad9e5970a3c0" (UID: "7b5d5e74-675a-45a3-8872-ad9e5970a3c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:40.590849 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.590827    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-kube-api-access-d7cgm" (OuterVolumeSpecName: "kube-api-access-d7cgm") pod "7b5d5e74-675a-45a3-8872-ad9e5970a3c0" (UID: "7b5d5e74-675a-45a3-8872-ad9e5970a3c0"). InnerVolumeSpecName "kube-api-access-d7cgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:13:40.689760 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.689731    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:40.689760 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:40.689755    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7cgm\" (UniqueName: \"kubernetes.io/projected/7b5d5e74-675a-45a3-8872-ad9e5970a3c0-kube-api-access-d7cgm\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:41.552985 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:41.552955    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"
Sep 12 03:13:41.573713 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:41.573687    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"]
Sep 12 03:13:41.577232 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:41.577208    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f91169-575ff756fd-bdkmf"]
Sep 12 03:13:42.161648 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:42.161613    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68da5c2a-4be2-47b4-b6ee-f02f640d1d5a" path="/var/lib/kubelet/pods/68da5c2a-4be2-47b4-b6ee-f02f640d1d5a/volumes"
Sep 12 03:13:42.162013 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:42.162000    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5d5e74-675a-45a3-8872-ad9e5970a3c0" path="/var/lib/kubelet/pods/7b5d5e74-675a-45a3-8872-ad9e5970a3c0/volumes"
Sep 12 03:13:47.065153 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.065120    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"]
Sep 12 03:13:47.065762 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.065361    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy" containerID="cri-o://c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406" gracePeriod=30
Sep 12 03:13:47.454921 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.454840    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"]
Sep 12 03:13:47.455254 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.455242    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68da5c2a-4be2-47b4-b6ee-f02f640d1d5a" containerName="revoke-keys"
Sep 12 03:13:47.455297 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.455256    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="68da5c2a-4be2-47b4-b6ee-f02f640d1d5a" containerName="revoke-keys"
Sep 12 03:13:47.455297 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.455287    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5d5e74-675a-45a3-8872-ad9e5970a3c0" containerName="payload-pre-processing"
Sep 12 03:13:47.455297 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.455293    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5d5e74-675a-45a3-8872-ad9e5970a3c0" containerName="payload-pre-processing"
Sep 12 03:13:47.455393 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.455362    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="68da5c2a-4be2-47b4-b6ee-f02f640d1d5a" containerName="revoke-keys"
Sep 12 03:13:47.455393 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.455371    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5d5e74-675a-45a3-8872-ad9e5970a3c0" containerName="payload-pre-processing"
Sep 12 03:13:47.458623 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.458609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:47.461361 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.461196    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4g6hp\""
Sep 12 03:13:47.461645 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.461613    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 12 03:13:47.465281 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.465258    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"]
Sep 12 03:13:47.557105 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.557078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47233291-56aa-4011-a200-2e70d0091df2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck\" (UID: \"47233291-56aa-4011-a200-2e70d0091df2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:47.658155 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.658122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47233291-56aa-4011-a200-2e70d0091df2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck\" (UID: \"47233291-56aa-4011-a200-2e70d0091df2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:47.658761 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.658741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47233291-56aa-4011-a200-2e70d0091df2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck\" (UID: \"47233291-56aa-4011-a200-2e70d0091df2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:47.770326 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:47.770257    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:48.041450 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:48.041420    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"]
Sep 12 03:13:48.042690 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:13:48.042655    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47233291_56aa_4011_a200_2e70d0091df2.slice/crio-eee99cd98402750fe5cd5042403f48f840b4be1c4c05c7d375433f636b21ad17 WatchSource:0}: Error finding container eee99cd98402750fe5cd5042403f48f840b4be1c4c05c7d375433f636b21ad17: Status 404 returned error can't find the container with id eee99cd98402750fe5cd5042403f48f840b4be1c4c05c7d375433f636b21ad17
Sep 12 03:13:48.594375 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:48.594337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck" event={"ID":"47233291-56aa-4011-a200-2e70d0091df2","Type":"ContainerStarted","Data":"49b5ebd6c79550d47b67e2d31684614df1a7a6c574ca077e30b6096925eb8505"}
Sep 12 03:13:48.594806 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:48.594388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck" event={"ID":"47233291-56aa-4011-a200-2e70d0091df2","Type":"ContainerStarted","Data":"eee99cd98402750fe5cd5042403f48f840b4be1c4c05c7d375433f636b21ad17"}
Sep 12 03:13:48.610484 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:48.610440    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck" podStartSLOduration=1.6104261640000002 podStartE2EDuration="1.610426164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-12 03:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:13:48.608559727 +0000 UTC m=+2260.864540744" watchObservedRunningTime="2026-09-12 03:13:48.610426164 +0000 UTC m=+2260.866407176"
Sep 12 03:13:49.602316 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:49.602280    2583 generic.go:356] "Generic (PLEG): container finished" podID="47233291-56aa-4011-a200-2e70d0091df2" containerID="49b5ebd6c79550d47b67e2d31684614df1a7a6c574ca077e30b6096925eb8505" exitCode=0
Sep 12 03:13:49.602785 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:49.602328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck" event={"ID":"47233291-56aa-4011-a200-2e70d0091df2","Type":"ContainerDied","Data":"49b5ebd6c79550d47b67e2d31684614df1a7a6c574ca077e30b6096925eb8505"}
Sep 12 03:13:50.740919 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:50.740892    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:50.891239 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:50.891152    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47233291-56aa-4011-a200-2e70d0091df2-maas-api-service-ca\") pod \"47233291-56aa-4011-a200-2e70d0091df2\" (UID: \"47233291-56aa-4011-a200-2e70d0091df2\") "
Sep 12 03:13:50.891535 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:50.891505    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47233291-56aa-4011-a200-2e70d0091df2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "47233291-56aa-4011-a200-2e70d0091df2" (UID: "47233291-56aa-4011-a200-2e70d0091df2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:50.992255 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:50.992222    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/47233291-56aa-4011-a200-2e70d0091df2-maas-api-service-ca\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:51.614780 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:51.614752    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"
Sep 12 03:13:51.614945 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:51.614755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck" event={"ID":"47233291-56aa-4011-a200-2e70d0091df2","Type":"ContainerDied","Data":"eee99cd98402750fe5cd5042403f48f840b4be1c4c05c7d375433f636b21ad17"}
Sep 12 03:13:51.614945 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:51.614879    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eee99cd98402750fe5cd5042403f48f840b4be1c4c05c7d375433f636b21ad17"
Sep 12 03:13:52.321398 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.321375    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:13:52.404858 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.404789    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-socket\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.404858 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.404823    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-certs\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.404858 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.404849    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-podinfo\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.404878    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-envoy\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.404922    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-token\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.404954    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77frv\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-kube-api-access-77frv\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405007    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-data\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405049    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-credential-socket\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405075    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:13:52.405104 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405102    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:13:52.405467 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405106    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istiod-ca-cert\") pod \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\" (UID: \"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee\") "
Sep 12 03:13:52.405467 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405267    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:13:52.405567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405483    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:13:52.405567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405492    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:52.405567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405546    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.405567 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405562    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.405716 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.405574    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.407338 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.407309    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:13:52.407468 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.407338    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-kube-api-access-77frv" (OuterVolumeSpecName: "kube-api-access-77frv") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "kube-api-access-77frv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:13:52.407539 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.407501    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:13:52.407597 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.407583    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" (UID: "d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:13:52.506385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.506360    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.506385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.506381    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.506385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.506389    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.506576 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.506397    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77frv\" (UniqueName: \"kubernetes.io/projected/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-kube-api-access-77frv\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.506576 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.506424    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.506576 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.506432    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:52.623026 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.622988    2583 generic.go:356] "Generic (PLEG): container finished" podID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerID="c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406" exitCode=0
Sep 12 03:13:52.623138 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.623045    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"
Sep 12 03:13:52.623138 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.623071    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" event={"ID":"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee","Type":"ContainerDied","Data":"c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406"}
Sep 12 03:13:52.623138 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.623122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h" event={"ID":"d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee","Type":"ContainerDied","Data":"3837ad478bb697923dded6218a8d7107cfefdeb3cd328c9d6ef69786808fb78f"}
Sep 12 03:13:52.623278 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.623145    2583 scope.go:117] "RemoveContainer" containerID="c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406"
Sep 12 03:13:52.632770 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.632751    2583 scope.go:117] "RemoveContainer" containerID="a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"
Sep 12 03:13:52.647363 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.647346    2583 scope.go:117] "RemoveContainer" containerID="c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406"
Sep 12 03:13:52.647673 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:13:52.647655    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406\": container with ID starting with c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406 not found: ID does not exist" containerID="c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406"
Sep 12 03:13:52.647734 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.647682    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406"} err="failed to get container status \"c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406\": rpc error: code = NotFound desc = could not find container \"c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406\": container with ID starting with c5a6922064fd6408f5612c0bb754c1611695a46703b8b1d1dc002a2515d75406 not found: ID does not exist"
Sep 12 03:13:52.647734 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.647698    2583 scope.go:117] "RemoveContainer" containerID="a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"
Sep 12 03:13:52.647963 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:13:52.647948    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878\": container with ID starting with a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878 not found: ID does not exist" containerID="a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"
Sep 12 03:13:52.648008 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.647965    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878"} err="failed to get container status \"a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878\": rpc error: code = NotFound desc = could not find container \"a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878\": container with ID starting with a150a8628c293f0069657c9971efe8e3a22fd6e14824b4b51ad84bac5244c878 not found: ID does not exist"
Sep 12 03:13:52.652614 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.652594    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"]
Sep 12 03:13:52.658308 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:52.658259    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-f91169-openshift-default-7f644844-xk75h"]
Sep 12 03:13:54.161855 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:54.161819    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" path="/var/lib/kubelet/pods/d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee/volumes"
Sep 12 03:13:57.957552 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:57.957514    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"]
Sep 12 03:13:57.958005 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:57.957769    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2" podUID="ab21a089-15ff-408d-861f-fdc55a4a57e3" containerName="payload-pre-processing" containerID="cri-o://82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578" gracePeriod=30
Sep 12 03:13:58.099798 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.099763    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"]
Sep 12 03:13:58.103242 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.102343    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-e401bd-g9xck"]
Sep 12 03:13:58.162618 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.162579    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47233291-56aa-4011-a200-2e70d0091df2" path="/var/lib/kubelet/pods/47233291-56aa-4011-a200-2e70d0091df2/volumes"
Sep 12 03:13:58.223717 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.223687    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:13:58.354436 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.354372    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab21a089-15ff-408d-861f-fdc55a4a57e3-plugins-config-volume\") pod \"ab21a089-15ff-408d-861f-fdc55a4a57e3\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") "
Sep 12 03:13:58.354619 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.354498    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtxnk\" (UniqueName: \"kubernetes.io/projected/ab21a089-15ff-408d-861f-fdc55a4a57e3-kube-api-access-rtxnk\") pod \"ab21a089-15ff-408d-861f-fdc55a4a57e3\" (UID: \"ab21a089-15ff-408d-861f-fdc55a4a57e3\") "
Sep 12 03:13:58.354768 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.354747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab21a089-15ff-408d-861f-fdc55a4a57e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab21a089-15ff-408d-861f-fdc55a4a57e3" (UID: "ab21a089-15ff-408d-861f-fdc55a4a57e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:13:58.356451 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.356427    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab21a089-15ff-408d-861f-fdc55a4a57e3-kube-api-access-rtxnk" (OuterVolumeSpecName: "kube-api-access-rtxnk") pod "ab21a089-15ff-408d-861f-fdc55a4a57e3" (UID: "ab21a089-15ff-408d-861f-fdc55a4a57e3"). InnerVolumeSpecName "kube-api-access-rtxnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:13:58.455132 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.455093    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab21a089-15ff-408d-861f-fdc55a4a57e3-plugins-config-volume\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:58.455132 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.455127    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtxnk\" (UniqueName: \"kubernetes.io/projected/ab21a089-15ff-408d-861f-fdc55a4a57e3-kube-api-access-rtxnk\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:13:58.660656 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.660617    2583 generic.go:356] "Generic (PLEG): container finished" podID="ab21a089-15ff-408d-861f-fdc55a4a57e3" containerID="82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578" exitCode=0
Sep 12 03:13:58.660827 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.660666    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"
Sep 12 03:13:58.660827 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.660684    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2" event={"ID":"ab21a089-15ff-408d-861f-fdc55a4a57e3","Type":"ContainerDied","Data":"82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578"}
Sep 12 03:13:58.660827 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.660735    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2" event={"ID":"ab21a089-15ff-408d-861f-fdc55a4a57e3","Type":"ContainerDied","Data":"0d7027e5729c880641b3b23041ea24574983daae3dbc97e07bd1f7730aca79c8"}
Sep 12 03:13:58.660827 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.660768    2583 scope.go:117] "RemoveContainer" containerID="82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578"
Sep 12 03:13:58.670086 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.670067    2583 scope.go:117] "RemoveContainer" containerID="82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578"
Sep 12 03:13:58.670354 ip-10-0-141-22 kubenswrapper[2583]: E0912 03:13:58.670332    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578\": container with ID starting with 82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578 not found: ID does not exist" containerID="82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578"
Sep 12 03:13:58.670490 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.670359    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578"} err="failed to get container status \"82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578\": rpc error: code = NotFound desc = could not find container \"82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578\": container with ID starting with 82dc03d6d17ba95f77204e41004323a9f771104e01c6182548cad34bf8fe3578 not found: ID does not exist"
Sep 12 03:13:58.682184 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.682158    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"]
Sep 12 03:13:58.685891 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:13:58.685870    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e401bd-5cfccc7c7d-2v8j2"]
Sep 12 03:14:00.160696 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:00.160660    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab21a089-15ff-408d-861f-fdc55a4a57e3" path="/var/lib/kubelet/pods/ab21a089-15ff-408d-861f-fdc55a4a57e3/volumes"
Sep 12 03:14:04.499427 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:04.499383    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"]
Sep 12 03:14:04.499879 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:04.499610    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" containerID="cri-o://fc71db540214004f3fba5fe5cad7686fdb628bf7098464dde1b6af0e812e5922" gracePeriod=30
Sep 12 03:14:07.378664 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:07.378620    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 12 03:14:07.379125 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:07.378713    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 12 03:14:08.915286 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:08.915253    2583 scope.go:117] "RemoveContainer" containerID="ac06df3bb4b1a44fa43da75f215501c39dd5a332ce1b1331d4042ef14fc417f5"
Sep 12 03:14:09.726724 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.726694    2583 generic.go:356] "Generic (PLEG): container finished" podID="380104eb-ba24-4bcb-81af-07ca57683002" containerID="fc71db540214004f3fba5fe5cad7686fdb628bf7098464dde1b6af0e812e5922" exitCode=0
Sep 12 03:14:09.726899 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.726760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" event={"ID":"380104eb-ba24-4bcb-81af-07ca57683002","Type":"ContainerDied","Data":"fc71db540214004f3fba5fe5cad7686fdb628bf7098464dde1b6af0e812e5922"}
Sep 12 03:14:09.726899 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.726829    2583 scope.go:117] "RemoveContainer" containerID="2f2076d21c6e5aa0e196d5d671e47a043d7e945b4677f0e4260fb53817fc659f"
Sep 12 03:14:09.757660 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.757640    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:14:09.865050 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865022    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-credential-socket\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865085    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-istio-token\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865116    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p9m2\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-kube-api-access-9p9m2\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-data\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865202 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865161    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-certs\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865472 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865215    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/380104eb-ba24-4bcb-81af-07ca57683002-istiod-ca-cert\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865472 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865268    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/380104eb-ba24-4bcb-81af-07ca57683002-istio-podinfo\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865472 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-envoy\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865472 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865352    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-socket\") pod \"380104eb-ba24-4bcb-81af-07ca57683002\" (UID: \"380104eb-ba24-4bcb-81af-07ca57683002\") "
Sep 12 03:14:09.865472 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865380    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:14:09.865472 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865464    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-data" (OuterVolumeSpecName: "istio-data") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:14:09.865775 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865484    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:14:09.865775 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865634    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380104eb-ba24-4bcb-81af-07ca57683002-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 12 03:14:09.865870 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865825    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:14:09.865870 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865776    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-data\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.865956 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865886    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-certs\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.865956 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865901    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/380104eb-ba24-4bcb-81af-07ca57683002-istiod-ca-cert\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.865956 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.865914    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-credential-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.867498 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.867469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 12 03:14:09.867621 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.867524    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/380104eb-ba24-4bcb-81af-07ca57683002-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 12 03:14:09.867803 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.867776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-kube-api-access-9p9m2" (OuterVolumeSpecName: "kube-api-access-9p9m2") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "kube-api-access-9p9m2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:14:09.867894 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.867860    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-istio-token" (OuterVolumeSpecName: "istio-token") pod "380104eb-ba24-4bcb-81af-07ca57683002" (UID: "380104eb-ba24-4bcb-81af-07ca57683002"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 12 03:14:09.966690 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.966654    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-istio-token\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.966690 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.966688    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p9m2\" (UniqueName: \"kubernetes.io/projected/380104eb-ba24-4bcb-81af-07ca57683002-kube-api-access-9p9m2\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.967046 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.966701    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/380104eb-ba24-4bcb-81af-07ca57683002-istio-podinfo\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.967046 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.966713    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-istio-envoy\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:09.967046 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:09.966726    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/380104eb-ba24-4bcb-81af-07ca57683002-workload-socket\") on node \"ip-10-0-141-22.ec2.internal\" DevicePath \"\""
Sep 12 03:14:10.733715 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:10.733677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn" event={"ID":"380104eb-ba24-4bcb-81af-07ca57683002","Type":"ContainerDied","Data":"0ea7e46cd420f301a9c77193a5e2c92d943f9955b610f8c34e06103f8c414d64"}
Sep 12 03:14:10.733715 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:10.733698    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"
Sep 12 03:14:10.733943 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:10.733760    2583 scope.go:117] "RemoveContainer" containerID="fc71db540214004f3fba5fe5cad7686fdb628bf7098464dde1b6af0e812e5922"
Sep 12 03:14:10.751548 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:10.751523    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"]
Sep 12 03:14:10.755175 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:10.755153    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e401bd-openshift-default-7f5d864f8b-59wbn"]
Sep 12 03:14:12.160657 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:14:12.160629    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="380104eb-ba24-4bcb-81af-07ca57683002" path="/var/lib/kubelet/pods/380104eb-ba24-4bcb-81af-07ca57683002/volumes"
Sep 12 03:16:08.816537 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:16:08.816507    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:16:08.820161 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:16:08.820141    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:16:08.830441 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:16:08.830413    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:16:08.833807 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:16:08.833789    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:18:08.976618 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:18:08.976537    2583 scope.go:117] "RemoveContainer" containerID="94c9feb6bd40e28f238024ea7720689d6b039566330528980be176ebe1532953"
Sep 12 03:18:08.984782 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:18:08.984760    2583 scope.go:117] "RemoveContainer" containerID="585c7c9a080aacf9a60703ad4676d1bd0dc7fc8bc35f038ccfc782de349f209f"
Sep 12 03:20:09.018048 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:09.017977    2583 scope.go:117] "RemoveContainer" containerID="1b3eb9fd4ccdf9f39fbe4a970618d459844b17f10e63aed591dece5c57246dca"
Sep 12 03:20:09.026724 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:09.026702    2583 scope.go:117] "RemoveContainer" containerID="a2880f3c258b5d6e3753145679fb1bdd63fbfcd7e63b694c39fd0c65169f8188"
Sep 12 03:20:09.034396 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:09.034379    2583 scope.go:117] "RemoveContainer" containerID="49b5ebd6c79550d47b67e2d31684614df1a7a6c574ca077e30b6096925eb8505"
Sep 12 03:20:30.778668 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:30.778611    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nz4fv_6fe87abf-3d80-4125-b1a0-f43772ea61c9/manager/0.log"
Sep 12 03:20:31.171654 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:31.171625    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-774995dcdd-x5lmw_afcf06f8-e763-4d27-b87f-6ebcff429446/copy-manifests/0.log"
Sep 12 03:20:31.178880 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:31.178857    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-774995dcdd-x5lmw_afcf06f8-e763-4d27-b87f-6ebcff429446/manager/0.log"
Sep 12 03:20:33.908637 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:33.908608    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp_79dfa8e8-2e9c-4f26-b7db-8191b9de51e8/istio-proxy/0.log"
Sep 12 03:20:34.029668 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:34.029638    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt2dm_14f24ad5-210f-41f2-b3ea-3925a7d2343e/discovery/0.log"
Sep 12 03:20:34.505833 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:34.505798    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9n6nk_15b83b5a-6126-463d-ae98-3ea42c988d51/payload-pre-processing/0.log"
Sep 12 03:20:34.743833 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:34.743800    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f78d98684-sxr7z_3b1b4539-0a79-4ad3-b093-0fe4994f04dd/router/0.log"
Sep 12 03:20:35.112303 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:35.112278    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vcjng_8c99f42c-207f-4e38-ab4e-448199b5ba9f/main/0.log"
Sep 12 03:20:35.467324 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:35.467254    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kxptq_1aa560f9-6171-4693-a1d4-4f82145c7230/main/0.log"
Sep 12 03:20:35.590030 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:35.589997    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmmqpk_6acac096-9360-425a-aa5d-decdb40e9a20/main/0.log"
Sep 12 03:20:44.602987 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:44.602955    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lrrtt_07438c10-c798-4c41-adbc-7cb89858375e/global-pull-secret-syncer/0.log"
Sep 12 03:20:44.722583 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:44.722553    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kd44x_91392b24-b012-4866-bbae-09944d2051f6/konnectivity-agent/0.log"
Sep 12 03:20:44.791235 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:44.791205    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-22.ec2.internal_63281233adfc708d92a6c41e2612bf0d/haproxy/0.log"
Sep 12 03:20:51.527399 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.527371    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/alertmanager/0.log"
Sep 12 03:20:51.549848 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.549819    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/config-reloader/0.log"
Sep 12 03:20:51.570090 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.570061    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/kube-rbac-proxy-web/0.log"
Sep 12 03:20:51.592950 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.592925    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/kube-rbac-proxy/0.log"
Sep 12 03:20:51.616880 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.616850    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/kube-rbac-proxy-metric/0.log"
Sep 12 03:20:51.640132 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.640115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/prom-label-proxy/0.log"
Sep 12 03:20:51.660764 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.660745    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_119899e1-f068-4f6e-81ba-33eb97ab9c8d/init-config-reloader/0.log"
Sep 12 03:20:51.695339 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.695315    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-trs5z_9307961d-04e4-4d29-8282-7a8099702591/cluster-monitoring-operator/0.log"
Sep 12 03:20:51.927668 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.927649    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h9frt_601447d7-cda0-46aa-93a1-c0c55cf6dcf4/node-exporter/0.log"
Sep 12 03:20:51.951613 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.951592    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h9frt_601447d7-cda0-46aa-93a1-c0c55cf6dcf4/kube-rbac-proxy/0.log"
Sep 12 03:20:51.975126 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:51.975107    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-h9frt_601447d7-cda0-46aa-93a1-c0c55cf6dcf4/init-textfile/0.log"
Sep 12 03:20:52.402219 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.402196    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-s7zmc_1a509e95-5d49-47aa-b160-989d511c63c2/prometheus-operator/0.log"
Sep 12 03:20:52.424179 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.424154    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-s7zmc_1a509e95-5d49-47aa-b160-989d511c63c2/kube-rbac-proxy/0.log"
Sep 12 03:20:52.452478 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.452458    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-zcstb_5c5af412-dead-4502-acee-dfe92bb8d385/prometheus-operator-admission-webhook/0.log"
Sep 12 03:20:52.494879 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.494859    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8464796d4-p5vhq_0aa2ed16-6253-4ceb-afc8-3167a9b5c386/telemeter-client/0.log"
Sep 12 03:20:52.525143 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.525115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8464796d4-p5vhq_0aa2ed16-6253-4ceb-afc8-3167a9b5c386/reload/0.log"
Sep 12 03:20:52.563564 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.563524    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8464796d4-p5vhq_0aa2ed16-6253-4ceb-afc8-3167a9b5c386/kube-rbac-proxy/0.log"
Sep 12 03:20:52.617121 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.617098    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b696fcf7c-c6m67_183f965b-e5b7-4a07-8469-c2e5b7cc077d/thanos-query/0.log"
Sep 12 03:20:52.638205 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.638185    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b696fcf7c-c6m67_183f965b-e5b7-4a07-8469-c2e5b7cc077d/kube-rbac-proxy-web/0.log"
Sep 12 03:20:52.666218 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.666169    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b696fcf7c-c6m67_183f965b-e5b7-4a07-8469-c2e5b7cc077d/kube-rbac-proxy/0.log"
Sep 12 03:20:52.687456 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.687426    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b696fcf7c-c6m67_183f965b-e5b7-4a07-8469-c2e5b7cc077d/prom-label-proxy/0.log"
Sep 12 03:20:52.711783 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.711758    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b696fcf7c-c6m67_183f965b-e5b7-4a07-8469-c2e5b7cc077d/kube-rbac-proxy-rules/0.log"
Sep 12 03:20:52.740055 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:52.740037    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b696fcf7c-c6m67_183f965b-e5b7-4a07-8469-c2e5b7cc077d/kube-rbac-proxy-metrics/0.log"
Sep 12 03:20:54.909232 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:54.909199    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:20:54.913490 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:54.913470    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/3.log"
Sep 12 03:20:55.468144 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.468118    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9b5555dbf-hxjrf_654b4917-2bbd-4230-ada9-0b3ce80db2e3/console/0.log"
Sep 12 03:20:55.499996 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.499971    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-c45fd_6f644ba7-a0c9-4f6b-a2a9-0a818116ac24/download-server/0.log"
Sep 12 03:20:55.861282 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861253    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"]
Sep 12 03:20:55.861788 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861766    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47233291-56aa-4011-a200-2e70d0091df2" containerName="revoke-keys"
Sep 12 03:20:55.861788 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861788    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="47233291-56aa-4011-a200-2e70d0091df2" containerName="revoke-keys"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861800    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861806    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861825    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861830    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861839    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861844    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861852    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab21a089-15ff-408d-861f-fdc55a4a57e3" containerName="payload-pre-processing"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861857    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab21a089-15ff-408d-861f-fdc55a4a57e3" containerName="payload-pre-processing"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861867    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy"
Sep 12 03:20:55.861930 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861874    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy"
Sep 12 03:20:55.862238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861938    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy"
Sep 12 03:20:55.862238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861946    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a15fb9-ba16-43a6-a2f1-fbc3a0d61cee" containerName="istio-proxy"
Sep 12 03:20:55.862238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861951    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="380104eb-ba24-4bcb-81af-07ca57683002" containerName="istio-proxy"
Sep 12 03:20:55.862238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861958    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab21a089-15ff-408d-861f-fdc55a4a57e3" containerName="payload-pre-processing"
Sep 12 03:20:55.862238 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.861966    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="47233291-56aa-4011-a200-2e70d0091df2" containerName="revoke-keys"
Sep 12 03:20:55.865197 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.865182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:55.867491 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.867474    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vchk2\"/\"kube-root-ca.crt\""
Sep 12 03:20:55.868588 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.868563    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vchk2\"/\"openshift-service-ca.crt\""
Sep 12 03:20:55.868706 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.868569    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vchk2\"/\"default-dockercfg-brcb4\""
Sep 12 03:20:55.871791 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.871772    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"]
Sep 12 03:20:55.988331 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.988300    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-proc\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:55.988714 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.988365    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86b8g\" (UniqueName: \"kubernetes.io/projected/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-kube-api-access-86b8g\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:55.988714 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.988431    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-podres\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:55.988714 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.988483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-lib-modules\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:55.988714 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:55.988558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-sys\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089463 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-proc\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089631 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86b8g\" (UniqueName: \"kubernetes.io/projected/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-kube-api-access-86b8g\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089631 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-podres\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089631 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089546    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-proc\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089631 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-lib-modules\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-sys\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089642    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-lib-modules\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-podres\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.089812 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.089681    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-sys\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.096874 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.096847    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86b8g\" (UniqueName: \"kubernetes.io/projected/b401cf94-dd5b-47ef-afd5-cead6f32f0bf-kube-api-access-86b8g\") pod \"perf-node-gather-daemonset-q2snm\" (UID: \"b401cf94-dd5b-47ef-afd5-cead6f32f0bf\") " pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.175579 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.175518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:56.447871 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:56.447843    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"]
Sep 12 03:20:56.448424 ip-10-0-141-22 kubenswrapper[2583]: W0912 03:20:56.448383    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb401cf94_dd5b_47ef_afd5_cead6f32f0bf.slice/crio-07c23c87130a84dddfda8fc93a0faed30511344be976a32845e319890dfb731a WatchSource:0}: Error finding container 07c23c87130a84dddfda8fc93a0faed30511344be976a32845e319890dfb731a: Status 404 returned error can't find the container with id 07c23c87130a84dddfda8fc93a0faed30511344be976a32845e319890dfb731a
Sep 12 03:20:57.001922 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.001887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm" event={"ID":"b401cf94-dd5b-47ef-afd5-cead6f32f0bf","Type":"ContainerStarted","Data":"1ad9325126fe88e0e59062d62270000cfc8fec5f18d540b715ca6fe3a3579c81"}
Sep 12 03:20:57.002299 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.001941    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm" event={"ID":"b401cf94-dd5b-47ef-afd5-cead6f32f0bf","Type":"ContainerStarted","Data":"07c23c87130a84dddfda8fc93a0faed30511344be976a32845e319890dfb731a"}
Sep 12 03:20:57.002299 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.001969    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:20:57.019479 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.019433    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm" podStartSLOduration=2.019418434 podStartE2EDuration="2.019418434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-12 03:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-12 03:20:57.018192165 +0000 UTC m=+2689.274173180" watchObservedRunningTime="2026-09-12 03:20:57.019418434 +0000 UTC m=+2689.275399485"
Sep 12 03:20:57.570583 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.570554    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxc6w_6d05a217-bc5c-4057-bf32-595614a6310c/dns/0.log"
Sep 12 03:20:57.589245 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.589220    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dxc6w_6d05a217-bc5c-4057-bf32-595614a6310c/kube-rbac-proxy/0.log"
Sep 12 03:20:57.677844 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:57.677822    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gm5gm_e65fb995-c074-4c75-8709-e11ad8ddd764/dns-node-resolver/0.log"
Sep 12 03:20:58.288134 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:58.288106    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zg9wj_20f66744-7567-4321-a774-8b0c260e5477/node-ca/0.log"
Sep 12 03:20:59.197179 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:59.197140    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp_79dfa8e8-2e9c-4f26-b7db-8191b9de51e8/istio-proxy/0.log"
Sep 12 03:20:59.622169 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:59.622138    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt2dm_14f24ad5-210f-41f2-b3ea-3925a7d2343e/discovery/0.log"
Sep 12 03:20:59.724391 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:59.724358    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9n6nk_15b83b5a-6126-463d-ae98-3ea42c988d51/payload-pre-processing/0.log"
Sep 12 03:20:59.773860 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:20:59.773834    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f78d98684-sxr7z_3b1b4539-0a79-4ad3-b093-0fe4994f04dd/router/0.log"
Sep 12 03:21:00.739796 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:00.739767    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xwmwg_fd7accf5-b2b2-4bc6-826e-25cd48d6444d/serve-healthcheck-canary/0.log"
Sep 12 03:21:01.317056 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:01.317026    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l24rx_1e3e4461-d584-4220-8322-805358ceda2d/kube-rbac-proxy/0.log"
Sep 12 03:21:01.340179 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:01.340155    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l24rx_1e3e4461-d584-4220-8322-805358ceda2d/exporter/0.log"
Sep 12 03:21:01.361285 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:01.361265    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l24rx_1e3e4461-d584-4220-8322-805358ceda2d/extractor/0.log"
Sep 12 03:21:03.017770 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:03.017743    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vchk2/perf-node-gather-daemonset-q2snm"
Sep 12 03:21:03.960528 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:03.960492    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nz4fv_6fe87abf-3d80-4125-b1a0-f43772ea61c9/manager/0.log"
Sep 12 03:21:04.137561 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:04.137532    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-774995dcdd-x5lmw_afcf06f8-e763-4d27-b87f-6ebcff429446/manager/0.log"
Sep 12 03:21:04.156177 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:04.156147    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-774995dcdd-x5lmw_afcf06f8-e763-4d27-b87f-6ebcff429446/copy-manifests/0.log"
Sep 12 03:21:05.521769 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:05.521684    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6645c7894d-cmmcn_e289c213-280b-4e10-b84a-345da8f0cbd5/manager/0.log"
Sep 12 03:21:07.017880 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:07.017849    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp_79dfa8e8-2e9c-4f26-b7db-8191b9de51e8/istio-proxy/0.log"
Sep 12 03:21:07.423792 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:07.423764    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt2dm_14f24ad5-210f-41f2-b3ea-3925a7d2343e/discovery/0.log"
Sep 12 03:21:07.497382 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:07.497347    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9n6nk_15b83b5a-6126-463d-ae98-3ea42c988d51/payload-pre-processing/0.log"
Sep 12 03:21:07.530948 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:07.530921    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f78d98684-sxr7z_3b1b4539-0a79-4ad3-b093-0fe4994f04dd/router/0.log"
Sep 12 03:21:08.861814 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:08.861781    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:21:08.866517 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:08.866492    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:21:08.872179 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:08.872158    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-r444n_75c9e2fc-13ee-45c0-824e-396644cb5fff/console-operator/2.log"
Sep 12 03:21:08.875615 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:08.875599    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:21:09.155399 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:09.155300    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-4rrzp_79dfa8e8-2e9c-4f26-b7db-8191b9de51e8/istio-proxy/0.log"
Sep 12 03:21:09.588385 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:09.588345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dt2dm_14f24ad5-210f-41f2-b3ea-3925a7d2343e/discovery/0.log"
Sep 12 03:21:09.665251 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:09.665193    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-9n6nk_15b83b5a-6126-463d-ae98-3ea42c988d51/payload-pre-processing/0.log"
Sep 12 03:21:09.705682 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:09.705651    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f78d98684-sxr7z_3b1b4539-0a79-4ad3-b093-0fe4994f04dd/router/0.log"
Sep 12 03:21:12.479613 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.479584    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/kube-multus-additional-cni-plugins/0.log"
Sep 12 03:21:12.499683 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.499659    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/egress-router-binary-copy/0.log"
Sep 12 03:21:12.519319 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.519261    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/cni-plugins/0.log"
Sep 12 03:21:12.539017 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.538994    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/bond-cni-plugin/0.log"
Sep 12 03:21:12.558448 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.558426    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/routeoverride-cni/0.log"
Sep 12 03:21:12.578041 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.578024    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/whereabouts-cni-bincopy/0.log"
Sep 12 03:21:12.597902 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.597883    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-49mpg_01fa6190-8c9c-47de-b592-3c42d9219593/whereabouts-cni/0.log"
Sep 12 03:21:12.934585 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:12.934555    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l4lzt_d5d9cdbc-b067-4f22-83ae-1917b30f4525/kube-multus/0.log"
Sep 12 03:21:13.129125 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:13.129098    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vt47l_79a51ccb-246e-44da-9d05-ec1c2a395d1a/network-metrics-daemon/0.log"
Sep 12 03:21:13.143919 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:13.143894    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vt47l_79a51ccb-246e-44da-9d05-ec1c2a395d1a/kube-rbac-proxy/0.log"
Sep 12 03:21:13.964779 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:13.964750    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-controller/0.log"
Sep 12 03:21:13.980080 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:13.980016    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/1.log"
Sep 12 03:21:13.980080 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:13.980038    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovn-acl-logging/0.log"
Sep 12 03:21:13.999197 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:13.999177    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/kube-rbac-proxy-node/0.log"
Sep 12 03:21:14.021861 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:14.021837    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/kube-rbac-proxy-ovn-metrics/0.log"
Sep 12 03:21:14.038993 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:14.038973    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/northd/0.log"
Sep 12 03:21:14.059277 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:14.059255    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/nbdb/0.log"
Sep 12 03:21:14.079572 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:14.079552    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/sbdb/0.log"
Sep 12 03:21:14.147280 ip-10-0-141-22 kubenswrapper[2583]: I0912 03:21:14.147254    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9lx45_35f5028d-d42b-49c2-84fb-0c297c87cee1/ovnkube-controller/0.log"